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PREFACE 


This book is written primarily for undergraduates, though 
Part I may be judged by some teachers to be suitable for 
mathematicians during their last year at school. It includes 
the convergence theory that is commonly required for a uni- 
versity honours course in pure and applied mathematics, but 
excludes topics appropriate to post-graduate or to highly 
specialized courses of study. It has taken shape from sets of 
lectures I have given at various times during some fifteen years 
of university teaching. 

The book develops the theory of convergence on the basis of 
two fundamental assumptions (one about upper bounds, one 
about irrational number as the limit of a sequence of rational 
numbers). With these assumptions the theory of convergence 
can be developed without appeal to the properties of Dedekind 
cuts. The 'real number’ appears in the appendix, where the 
assumptions of the book are proved to be consequences of the 
definition of 'real number’. 

The notation, or shorthand, used in the text is one that is 
familiar to the professed analyst and is a commonplace of the 
lecture-room. It is something of an experiment to employ it in 
a text-book, but its almost universal adoption in recent years 
by mathematical undergraduates at Oxford leads me to hope 
that it will prove acceptable. My own teaching experience is 
that students who use the notation acquire clear ideas of what 
they have to prove and of how they may prove it. 

Of the details, few call for mention in the preface. The treat- 
ment of Tannery’s theorem in Chapter XVI grew out of (i) 
Professor E. H. Neville’s note in the Mathematical Gazette , vol. 
xv, p. 166 , (ii) a remark once made to me by Professor Hardy, 
and (iii) my own work on a special series. I cannot resolve how 
much is due to each, but I am sure the chapter owes much 
both to Professor Neville and to Professor Hardy, and I gladly 
take this opportunity of acknowledging my indebtedness to 
them. The brief chapter on Fourier series will, I hope, prove 
useful in spite of its brevity and many omissions. The appendix 
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contains just so much of the 'foundations of analysis’ as is 
necessary to the justification of the assumptions made in the 
early chapters of the book. These 'foundations’ are prefaced 
by a very brief historical sketch that tries to show why such a 
complex structure as a Dedekind cut is necessary to the defini- 
tion of 'number 5 . 

All theorems are numbered. Some references to previous 
theorems are given in parentheses; if the reader can follow the 
proofs without consulting these references, so much the better. 
They are given so that readers may, if necessary, look up points 
they have forgotten: it is not intended that proofs in conver- 
gence theory should bristle with references to previous theorems 
in the manner of the old Euclid books. Though, of course, the 
order of proof is as important here as it is in the development 
of Euclidean geometry: we must not use A to prove B, and then 
use B to prove A. 

The examples contain many questions set in university 
examinations and many questions taken from my own notes; 
of the latter, some are original and some are not. The majority 
are reasonably straightforward;' hints for their solution are 
occasionally given. There are a few examples marked £ j Harder', 
and the beginner is advised not to attempt them on a first 
reading. 

Professor A. L. Dixon and Professor E. T. Copson have 
kindly read the proof sheets, and I am deeply grateful to them 
both for their helpful criticisms. Professor Copson has read 
and criticized all the text and has worked nearly all the 
examples. I wish to thank him most sincerely for this evidence 
of his friendship. 

In conclusion, I should like to thank the staff of the Oxford 
University Press for their work on the book and for their un- 
failing courtesy towards me in all matters concerning it. 

W.L.E 

HERTFORD COLLEGE, 

OXFORD 

16 November 1937. 
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CHAPTER I 

PRELIMINARY DISCUSSION 


1 . Definition. A set of numbers in a definite order of occur- 


rence, 


a lJ a 3>***J a n,j***> 


is called a sequence. 


Examples. 5, 6, 7; 


111 

2 5 4 5 g 5 *“ 5 2 ^ 5 *’* 9 


1 11 1 

3’ 5’7’ 9’ ’ * 


If the sequence stops, as in the first example, which has only 
three terms, it is called a finite sequence. If the sequence 
does not stop, as in the second and third examples, it is called 

an INFINITE SEQUENCE. 

In what follows w T e shall be concerned chiefly with infinite 
sequences. We shall use three notations for a sequence: 


a 3>’**3 ^tt’*** > 

( n = Ij 2,...), 

or simply (oc n ). 

The advantages of alternative notations soon become 
apparent. 


2. Preliminary discussion of convergence 
2.1. Throughout the rest of this chapter we shall discuss, 
with no attempt at final precision, some of the ideas which 
are the subject of the more precise work in Chapter II. We 
begin with an elementary example of an infinite series, namely 

l+i+i+i+--- • (1) 

If s n is the sum of the first n terms of this series, then 



As n grows large, (i) 71-1 becomes small, and, in fact, we can make 
(i) 71-1 as small as w r e please by taking n large enough. In other 
w r ords, s n approximates to 2 as n becomes large. We say, accord- 
ingly, that s n converges to (i.e. approaches or approximates to) 2. 
This is the general notion underlying convergence — 

CONVERGENCE IS ‘APPROACHING’, OR ‘APPROXIMATION 5 . 
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Suppose we are given any infinite series 

u i J r u 2 J r u z J r — (2) 

Let s n == n 1 +n 2 +...+n n . We say that the series (2) converges 
if s n , as n becomes large, approaches some definite number s. 
This number s is called the sum of the series; the series 
itself is said to converge, or to be convergent. 

Notice that this use of the word 'sum 5 is not the same as its 
use when we say that ‘the sum of l + i + i is If’. It is a special 
use of the word ‘sum’ in its application to infinite series. 

An example of a convergent series. 

r2!3 + 2.3.4 + "‘ + n(K+l)(?i+2) + "" ^ 

Here, the nth term, u n) is given by 

= 1 = 1 f 1 1 1 

Un n(n+l)(n+2) 2(n(n+l) (n+l)(n+2)J ? 

and so w 1 +^ 2 +---+^n = — t . 

ii 2 * t » 2 \i. 2 (n+l)(n+2)j 

Accordingly, s n = %+w 2 +...+w 7l 

approaches J as n becomes large: we say that the series (3) 
converges and that its sum is J. 

Note. This is a standard method of dealing with a standard 
type of series, namely the type in which the nth term, 
u n , can be expressed in the form v n —v n+1 . 

Examples I 

h If M » s= «(»+l )(n+2)(n+3)’ then “ 1+ “ 2+ - is a e ° nv ergent 
series and its sum is 1/18. 

2. If u. = — — — , then 

n n{n + 2)’ 

. , , 1/3 1 1 \ 

Ul + u t +...^u n = 

w i+w 2 -f... is a convergent series, and its sum is J. 

3. If u n ~ _ T 9 \ (n + 3 ) ? s k° w ’ us * n g partial fractions, that 
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u 1 +u,+ ... + u n = \ + \[ 1 ±- 2 ~^)- 
Hence show that u 1 -{~u 2 + ... is convergent, and its sum is £. 

4. Pind the sum of the series u 1 J fU 2 J r u 3 +... when u n is 
2n~f 3 n 2 

(1} (n+l)(n+2)(n + 3)’ W (n-l)n(Hl)(n + 2) , 

, 2^+1 . . 

(lu) n®(n+l)" 2 * (1V) (n-f l)(n + 2)(n + 3)‘ 

2.2. Series which diverge. Consider the series 

1+2+3+.. .+7i+ — (4) 

Here s n = w 1 +^ 2 +---+ w n = l+2+...+w- 

= \n{n+ 1). 

In this example, if n is large, then so is s n . 

For our purposes we need some refinement of the last state- 
ment. In discussing the series (1) we stressed the fact that 
‘we can make the difference between s n and 2 as small as we 
please’. Here, with series (4), we can make s' n as large as we 
please by taking n sufficiently large. The refinement we fasten 
on, then, is this: The sequence s n increases indefinitely; that is to 
say , whatever positive number A we care to put down , s n will 
exceed A if we choose n large enough. 

The series (4) is said to diverge, or to be divergent. 

Another example of a divergent series is 

l + 2 + 2 2 +... + 2”~H-.... (5) 

Here s n = l + 2+... + 2 n ~ 1 == 2 n — 1, and again s n increases 
indefinitely. 


2.3. The dependence of series on sequences. In the 
foregoing discussion of the convergence or divergence of a given 


series, 


%+w 2 +...+w 7l +..., 


we have seen that it is the behaviour of the sequence 

where s n = u 1 J r u 2 J r ... J r u n , which is m question. 

We shall, accordingly, leave aside infinite series for a while 
and turn our attention to sequences. 
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3. Sequences that converge to zero 

(i) If 0 < x < I, then the sequence 

ry> /y*2 0^3 

^ J X 5... 

converges to zero . 

To see this, put 2 / = (1/x), so that y > 1. Put 

2/ = 1+J> (J3 > 0). 

Then i/ 2 = l+2^)+p 2 > l-j-2jP, 

and, by induction, y n > 1 -\~np. 

Accordingly, y n increases indefinitely and x n , or y~ n , decreases 
indefinitely in the sense that we can make its value as near 
nothing as we please by taking n large enough. 

(ii) This example is much more difficult: its result is often 
useful. [It may be omitted on the first reading.] 

If y is a fixed number greater than unity , and fc is any fixed 
positive integer , then the sequence 

n kjyU — l 3 2 ,...) 

converges to zero. 

Before we give the proof of this theorem we try to explain some of the 
ideas that lead to the proof. 

(i) Numbers like 10 6 — 5, lO 6 !-? are ‘about as big’ as IQ 6 : in calcula- 
tions involving numbers as big as 10 8 , a relatively small number like 
5 or 7, when added to or subtracted from 10 6 , will have very little effect 
on the result of the calculations. 

If Z is a fixed number and n is to be thought of as a very large number, 
then n— l is ‘about as big’ as n. Further, extending this idea a little, if 
it is a fixed number and n is to be thought of as a very large number, 

then rc{n-l)(n-2)...(n-jfc) 

is ‘about as big’ as n fc+1 . 

This idea is useful in many problems. 

(ii) The y of our problem exceeds unity and we can write 

y n = (1 +p) n (p > 0). 

The right-hand side can be expanded, when n is a positive integer, by 
the binomial theorem, and, since each term of the expansion is positive, 
the whole is greater than any single term of the expansion. 

So, if we take n > &+ 1, 
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(iii) Hence, when n is thought of as a large number, 

n k [y n 

is n 1: divided by a number about as big as (or bigger than) 
n*+ip*+i/(Jc+l)l 

Now p and k are fixed, and so n^jy 71 is, for large n, comparable with a 
fixed multiple of (1 Jn) t and we can make its value as near zero as we 
please by choosing n large enough. 

Formal proof. We are concerned with what happens when 
n is large; so we may confine our attention to values of n that 
exceed k+ 1. When n > k+l and y = l+p, where p > 0, 


y n — (i+j>) n > 


n(n—l)...(n—Jc) 

(fc+lji 


pk+1 


> (n— k) kJrl p kJrl l{k-{-l)\ 


Hence 


n k (Jfe+1)! 


n* 


yn pk+i 72 , fc+1 (l — k/n) k+1 

[This step arrives at the n k jn kJrl which our preliminary talk led us to 
expect — we now get rid of n from all other terms.] 

But, when n > k+l, 

k 1 • 


i-- > i- 
n 


and so 


y n 


k+l k+l 5 

(Jfe+1)! (fc+l) fc+1 1 


p 




n 


and the theorem follows [p, k are fixed numbers]. 

Note. Having isolated the n k+l of y n , we use the roughest 
of inequalities to deal with the rest: the sole object of the 
manipulations is to remove n from every place save the 
one essential place where we want it at the end, namely l/n. 



CHAPTER II 
FORMAL DEFINITIONS 


1. Forma! definitions of convergence 

1.1. Sequences which converge to zero. A sequence like 
an =(-)"n- 1 (n= 1,2....) 

shows that the approach to zero need not be from one side only. 
It is the absolute valuef of a n , that is, in the usual notation, 
which is in question. 

A sequence like 

111 J_ l__ 

2 5 i? 4’ 3 5 **’ 2n 2n-P"*’ 


though artificial in structure, is enough to show that a sequence 
<x n can approach zero without having its terms become steadily 
smaller: the approach to zero need not be a steady one. 

Finally, one is tempted to say that a n will converge to zero 
if a n can be made as small as we please £ by taking n sufficiently 
large’. But this is not quite accurate. In the sequence 


ill 11 , 1 L_ /- 

2’ 3’ ’ 4’ 5’ 2k’ 2i+l’ c ’’" 


(A) 


we can make the nth term as small as we please by taking n 
sufficiently large if we keep to values of n that are not multiples 
of 3. The sequence as a whole does not converge to zero because, 
in every third place, the sequence 1,2,3,... runs through it. 
In our formal definition we use the phrase ‘by taking any n 
that is sufficiently large’ instead of £ bv taking n sufficiently 
large’. We cannot make the nth term of (A) as small as we 
please by taking any n that is sufficiently large; we can do so 
only by taking certain n that are sufficiently large. 

These preliminary remarks made, we give our first form of 
the definition. 


Definition. Form A. The sequence 
is said to converge, or tend, to zero (in symbols, ot n -> 0) 

t If a is a real number, |et| = a when a is positive and | a] = — a when a is 
negative; e.g. [ — 6| = 6, |7| — 7. 
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e if \ aj} | can be made as small as we please by taking any n that 
is sufficiently large’ . 

Let us examine this and put it wholly into symbols. We 
£ can make |a M | as small as we please’ if, on putting down any 
positive number € whatsoever, we can make |aj < 6. 'By 
taking any n that is sufficiently large 5 means that the relation 
in question, namely \a n \ < <r, will hold for all values of n ^ 
some definite number, N say. 

Hence, our condition that oc n -> 0 may be stated in the form 
B, given below. 

Form B. cc n — > 0 if, having chosen any positive number e what- 
soever , we can then find a definite number N such that 
|aj < e when n > N. 

The important point to notice is that, for oc n to tend to zero, 
we must be able to find our N no matter what positive e we 
have chosen to start with: it is not enough to be able to find 
N when we have taken e to be one particular very small number 
like 10 -6 . We have to be able to make \a n \ as small as we 
please and not merely as small as 1Q~ 6 . 

1.2. The definition in symbols. We now introduce a nota- 
tion that is useful both in curtailing long-winded statements 
and in helping one to handle the technique of convergence 
questions. 

We write down form B in this notation: it becomes 
Form C. a n 0 if 

e > 0; 3 N . \ot n \ < € when n > N. 

In reading this notation, vffiat comes before the semicolon is 
set down to begin with (and is subject to no limitation that 
is not explicitly shown), wdiat comes after the semicolon is 
dependent on what comes before. In detail the notation is 
read 

(i) e > 0; £ on putting down any positive number e whatsoever 
to begin with’, 

(ii) ; separates what is put down to begin with from what 
can be said after it has been put down, 
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(ill) 3 means 'there exists’, 'there is (a number)’, 

(iv) the point , means 'such that’. [It is useful to have a 
shorthand for this frequently used phrase.] 

Thus the whole reads -> 0 if, on putting down any posi- 
tive number e whatsoever to begin with, there is some number 
X such that \oL n \ < e when n ^ A 7 ’. 

1.3. The three definitions. The form A says all that is 
necessary but, in the technique of later work, it is not so con- 
venient as the form B, and this again is not so convenient as the 
form C. All three say the same thing in a different form of 
words. 

In using C it must always be remembered that e > 0; means 
'putting down any positive number € whatsoever to begin with’. 
The € is set down at the beginning, a fact that cannot be 
stressed too much. 

2. Sequences that converge, but not to zero 

2.1. Form A. The sequence cq, a n ,... is said to converge 
or tend to l {in symbols , <x n — > l) if the sequence 

a 2 — Z,..., a n — Z,... 

tends to zero. 

If we use the forms B and C of the definition in § 1, this 
becomes 

Form B. a n ->l if, having chosen any positive number e 
whatsoever, we can then find a definite number N such that 
|cq,— Z| < € when n ^ N. 

Form C. a n -> Z, if 

€ > 0; 3 X . \y. n — Z| < e whenn ^ N . 

The form C is, of course, the shorthand or symbolic form of B. 

2.2. Notation. We call l, above, the 'limit’ of the sequence 
(«»)• 

3. Properties of convergent sequences 

3.1. Theorem 1. A convergent sequence is bounded , i.e. if 
cc n -> a, then there is a number K such that 

|a n | < K for ALL n. 
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We shall use, here and later, the shorthand (or notation) 
of §L2. 

Proof. Since oc n -> a, 

3 N x . |a^ — a| < 1 when n > N v (1) 

[In the forms B and C of our definition, e is any positive 
number whatsoever: in the line (1) we choose to take € — 1: 
we have a special object in view and any definite choice of an e 
will serve our present, very special, purpose.] 

Hence, f when n ^ N v 



Kl = l(«„— “)+<*! 



< K a l4" l a l 



< l+|a|. 

(2) 

The numbers 

Kl, KI,-> kv-il 


form a finite set of numbers and so one of them, |a r | = 

= %i say, 


is greater than or equal to each and every other one of the set. 

[aj ^ a definite K x when n < N v (3) 


From (2) and (3), if K is any number greater than K x and 
1 + 1“ I’ then |«J < K for all n. 


3.2. Theorem 2. If a ;i -> a and <x tl > c for all n , 
then we can deduce that a ^ c. We cannot, from the hypotheses , 
deduce that a > c. 


Proof . Let A be any number less than c. Then c— A is a 
definite positive number and 

a n — A > c — A > 0. 

Hence \oc n — A|, which is ot. n — A, is never less than a certain 
positive number c— A and so, as we see from form B of § 2, 
ol u cannot converge to A. 

That is, oc n cannot converge to any number less than c, 
and so a > c. 


t Note, for all work with absolute values, 

|a+6| < |a| + |6|. 

If the result is not known, it can easily be verified when a and b are real 
numbers. 
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An example to show that a. may he equal to c. 

Let ol h — n-\ so that ot n -> 0, i.e. ct = 0. Here, for each 
value of n. y. a > 0, but a = 0. 

Corollary. If oc n -> a and <x fl < c for all n 9 then we can 
deduce that a < c. 


4. Formal definitions of divergence 
4.1. Sequences which diverge through positive values. 
We give three forms of the definition of a divergent sequence; 
each says the same thing in a different way. The three forms 
A, B, C correspond to the three forms used for convergent 
sequences in §§ 1, 2. 

Definition. The sequence 

-aq, 0 ^ 2 ? * * * 5 ^nv 

is said to diverge through positive values 
Form A. if <x tl increases indefinitely. 

Form B. if, having chosen any positive number A whatsoever , 
we can then find a definite number N such that a n > A when 
n ^ N. 

Form C. A > 0; 3 N . > A when n > X. 

Examples, (i) — n . Whatever positive number A we set down, 

ol h > A if n ^ 1 — A. 

(ii) ca n = where p > 0. We know (§ 3) that a n > 1 +np, so 

that ct n > A when l~f -rip ^ A, that is, when n > {A — l)!p. 


4.2. Sequences which diverge through negative values. 

The sequence , ^ 

(oi n ), l.e. oq, oc. 2 , OL n> ..., 

is said to diverge through negative values if the sequence 

(—*«)» i-e- — «i. — <*2>— » —<*»>—> 
diverges through positive values. 


Examples, (i) «„ = — n; (ii) 


-n* 


4.3. Non-convergent sequences. There are certain 
sequences that are neither convergent nor divergent. An 
example is lf 0 , 1, 0, 1, 0,..., 


or again 1, 2, i, 3, J, 4 ,... . 

We call such sequences 'non-convergent 5 or 'oscillating 5 . 
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5. Important properties of finite sequences 

5.1 • Least terms of sequences. If we have a finite 
number of terms oq, a n , 

n terms in all, then there must be one of them which is less 
than or equal to each and every other term. For example, in 

1, 2, 3, 3, 2, 1, 

six terms in all, the first is less than or equal to each of the 
others. 

If we have an infinite sequence 

Oq, < 2 2? 

there may or may not be such a term. For example: 

(i) 1, 2, 3,... is an infinite sequence and the first term is less 
than any other, 

(ii) 1, -1-, -J,... is an infinite sequence and whatever term of it 
we take we can always find a term less than it. 

We cannot sjoeak of the least term (or terms) of an infinite 
sequence until ice have shown that there is one. 

This simple fact is one of the fundamental differences between 
a ‘finite number of terms’ and ‘an infinity of terms’. The same 
remark applies, of course, to the ‘greatest term’. 

In the same order of ideas, if we have a finite sequence 
a v a 2 ,..., a n , 

n terms in all, then the sequence is necessarily bounded, that is, 
there is some number K such that \a r \ < K for r — 1 , 2 ,..., n . 
With an infinite sequence this is not so, it may or may not 
be bounded. For example, a divergent sequence is not bounded, 
whereas (Theorem 1) a convergent sequence is bounded. 

6. A practical way of looking at convergence 

Suppose <x n -> l. Then 

e > 0; 3 N . |oc n — Z| < e when n > N. (1) 

Think of the point l and the various points a ^ marked off on a 
straight line, using distances from a fixed point 0. Then (1) 
says whatever marks we make at a distance e on each side of l , 
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then, from and after some value N, <x n will lie within these marks. 
The value of IV will depend, of course, on where we put the 
marks. 

If we know that a n -* l , we can sometimes get all the facts 
we want for our subsequent work by making the marks in 
special places. Thus, suppose l > 0, as in Fig. A. We can 

» 

0 T^e l 1+7 '21 id 

Fig. A. Fig. B. 

put the marks at U and U and then, if a n -> l, we can say that, 
when n ^ some definite N , <x R > \l. Again, if Z < 0, as in 
Fig. B, we can put the marks at 0 and 21, and so there is a 
number A T such that <x n < 0 when n ^ N. 

Readers will best see the force of these remarks when they 
come to Theorem 12, though they are useful in many other 
connexions. 


Examples II 


1. Prove that the sequence (a^) converges to zero when oc n is given by 


(ii) Sw2’ (iii, fr 


(iv) 


- 1 ’ 


*(v) 


n+ 5 
\n 3 


The point of such examples is to show that form B (or C) is satisfied. 
They are intended for practice only: a much more efficient method of 
proving the results w r ill be given in Chap. VI, § 2.2. 

In approaching an example, such as the fourth, it is simplest to work 
in this way. 

First. We may expect (n 2 + 3)/(n 3 — 1) to behave very much like 
n 2 Jn 3 when n is a large number. 

[In a numerical calculation where n = 10 6 , say, we would never 
concern ourselves with the difference between 1G 12 and 10 12 + 3.] 

Second. The actual work, which is guided by the thought contained 

in the first: „ „ 

n 2 + 3 < 2n 2 when n > 2, 

n 3 — I > £n 3 when n > 2. 


Hence 0 < a n < 1 when n > 2. Accordingly, e > 0; [or, in full, 

on putting down any positive number e whatsoever] 

|a n | < € when n > l/4e and n > 2, 

and so the condition that a n — > 0 is satisfied. 
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Note. Actually, one could prove that when n is large enough 

1,3-1 r 3-00...1] 

< — I «- or n — , 

n n 2 L n 2 J 

but there is no point here in doing anything more subtle than ‘get 
the n~ l standing clear with some definite numerical multiplier’, such 
as 4. 

2. Prove that a n 1, 3, 4 according as oc n is given by 

n ,... 3?i 2 + l . ..... 4n 3 +6n-7 , 

(i) — -T, (ll) 2 — > 5 )’ 111 “3 — o~ TTY > 1 )• 

w+1 ?i 2 — 5n n 2 — 2n 2 +l 

We work (ii). We may expect the sequence to approach the same 

value as 3 n 2 /n 2 , i.e. 3 [for n 2 will outweigh n when n is large]. Now 

0 3n 2 + l 15w+l 


n 2 — 5n 


n 2 — 5n 9 


and 7 i 2 — 5n > -J-u 2 when n > 10. Hence, when n > 10, 


e > 0; 3- 


3n 2 + l lgn 32 
n 2 — 5n ^ -Jn 2 w ’ 

3n 2 + l| 

- — — < e when > • 


e > 0; 3 N . [a n — 3| < e when n > N. 


3. Show that the sequence (a n ) given by (i) in Example 2 has a least 
but not a greatest member. 

Harder. In Example 2 (iii), (<x n ) has a greatest but not a least member. 
[Write a n in the form 4-f-(8ft 2 -j~6?'i— ll)/(n 3 — 2n 2 + l).] 

4. Show that the sequence ( x n ) tends to zero when x is a fixed positive 
number less than unity. 

5. Show that, when y is a fixed number that exceeds unity and h is 
a fixed positive integer, the sequence (n k !y n ) converges to zero. 

[Cf. Chap. I, § 3, where, however, the formal definitions of con- 
vergence were not used.] 

6. Prove that, if c is a constant and if a n a, then a n +c — > a+c and 


ca. n — > col. 

7. Prove that, if cc n a, then |a n J |a|. 

8. Show that the sequence (a n ) diverges through negative values 
when cx n is given by 

(i) 6— n 2 , (ii) -2 tt , (iii) (-%) 2 ^. 



CHAPTER III 

BOUNDS: MONOTONIC SEQUENCES 

1. The bounds of a sequence 

1.1. A fundamental assumption. In the next section, 

1.2, we make an assumption; namely, that a certain set of 
numbers has in it a least number. The assumption is marked 
with an asterisk. If we are prepared to make a thorough 
examination of the definition and theory of real number, we can 
prove that the assumption is justified. This examination is 
made in the appendix (it is not altogether easy), and in the 
course of that examination our assumption appears as a theorem. 

1.2. The upper bound of a sequence. Let (a n ) be any 
sequence of real numbers. Then 

either (i) there is a number ^ every a n , and so there is an 
infinity of such numbers, 
ok (ii) there is not a number ^ every a n . 

In case (i), having fixed on one such number, then every 
greater number is also ^ every ot n , and possibly, though not 
certainly, there may be a less number with this property 
every a n ). 

Assumption l.* We assume that in case (i) there is a least 
number , U say , which is greater than or equal to each and every <x n . 

Definition. The uppek bound, U, of a sequence (<x n ) is the 
least number which is greater than or equal to each and every oc n . 

It follows at once from the definition that if XJ' is any 
number less than U, then there is at least one a n that exceeds 
U\ We embody this important fact in the theorem which 
follows. 

Theobem 3. If U is the upper bound of (cc n ), then , given any 
number U' less than JJ , there is at least one oc n such that 
U' < < U. 

In case (ii) the sequence (a n ) has no upper bound (in the sense 
of the previous definition). The definition that follows is an 
alternative way of stating the same fact. 
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Definition". If there is no number > each and every ot n , we say 
that the upper bound of (a n ) is plus infinity [+oo]. 

This is merely a convenient way of saying 'whatever number 
A we take, there is at least one a* that exceeds A\ The defini- 
tion does not postulate a number 'infinity'. 

When we are dealing with case (i), and so with the definition 
on p. 16, we shall refer to the upper bound as finite. 

The lower bound of a sequence is similarly defined: it may be 
finite or 'minus infinity’. 


1.3. It is convenient at this point, having introduced one 
conventional use of the word 'infinity’, to notice others of a lik e 
character. 

If oc n diverges through positive (negative) values, then we say 
that diverges, or tends, to plus (minus) infinity We write 
u n -j-oo, —oo, as the case may be. 

If the sequence ( <x n ) converges to a (compare the definitions 
of Chap. II, §§1, 2), we sometimes, for convenience, say that 
oi n tends to a as n tends to infinity; in symbols, -> a as 

^ c °’ or lim = a. 


1.4. Examples of upper and lower bounds. In many 
examples it is easy enough to see what the upper and lower 
bounds are. 

With the (infinite) sequence of numbers 


1 is clearly the least number that has the property of being 
greater than or equal to each and every number in the sequence; 
0 the greatest number that has the property of being less than 
or equal to each and every number in the sequence. Hence, the 
upper bound is 1 and the lower bound is 0. 


[Notice that it is ‘greater than or equal to’. Assumption 1 would be 
completely false if it said merely ‘greater than’. There cannot be a least 
number greater than 1: for suppose x to be the least number greater 
than 1; then > J and J(l+rr) > 1, while ^(l-f#) < x; and so x 
cannot be the least number greater than 1.] 
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Again, with the sequence 

0, —1, — 2, —3,..., 

0 is clearly the least number greater than or equal to each and 
every number of the sequence, and so the upper bound is 0; but 
the numbers decrease indefinitely and the lower bound is — oo. 

2. Monotonic sequences 

2.1. Definition. When a n+1 ^ <x n for all values of n , the 
sequence (a n ) is said to he monotonic increasing, or, in abbrevi- 
ated form, m.i. 

When a n+1 > for all values of n, the sequence is said to 
be steadily increasing or monotonic increasing in the strict 
sense. The difference lies in the exclusion of the possibility 
a n+1 = oi n for some or all values of n: it is not often needed, but 
is occasionally important. 

A monotonic decreasing (m.d.) sequence is similarly de- 
fined; (a n ) is m.d. if oc n+1 < oc n for all n. 

Note. The whole theory of convergence of series of positive 
terms depends on the study of monotonic sequences. 
Theorem 4, which follows immediately, and Theorem 19, 
which comes in a later chapter, are the tw r o fundamental 
theorems of convergence theory. 

Theorem 4. If (oc n ) is a monotonic increasing sequence, then 
either it has a finite upper bound U, and a n -> U, 
or its upper bound is +co, and u n -*> +oo. 

The main point of this theorem lies in the proof of the fact 
that a monotonic sequence either converges or diverges — it 
cannot be merely non-convergent, as are the sequences of 
Chap. II, §4.3. 

We first consider the case when (a n ) is m.i. and has a finite 

upper bound U. Put down any positive number e to begin 

with ; then U—e < U and, by Theorem 3, there is at least one 

a v such that TT ^ rr 

U—€< a N ^ U. 

[The reader will probably follow the subsequent argument more 
easily from the figure.] 
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But 0 L k+ 1 > rx k for an ft, and so 

oc n > a iv when > N\ 
while, by the definition of upper bound, 

a n <,V for all values of n. 

U — e a N a n U 

Hence, U-e < a v < a„ < U when n^zN, 
and. so 0 ^ U—<x n < U ( U — e) = e. 

That is, e > 0; 3 N . \U — «J < e when n^N, 

and, by the formal definition of convergence, -> V . 

[The explanation of € > 0; 3, etc., is given in Chap. II, 

§1.2.] 

Now suppose that the upper bound is plus infinity. Then 
A > 0; 3 an a n , say a v , that exceeds A. 

Moreover, oc n ^ a v when n > N, 

so that 3 N . oc n > A when n ^ N. 

By the formal definition of divergence, a n diverges through 
positive values, or, as we have agreed to write it (§1.3), 
On"* +°°- 

Cobollaby 1. If (<x n ) is monotonic increasing, and there is a 
number M such that 

ol u < M for all n, 

then the sequence {ocf) converges to some number XJ ^ M. 

By the definition of upper bound, the upper bound, U say, 
of (aj is a number < M . Also, by the theorem, a n U. 

Cobollaby 2. If (oc n ) is monotonic decreasing , then 
eitheb it has a finite lower bound L , and <x n -* L , 
ob its lotver bound is —go, and — oo. 

In the next chapter we shall make important applications 
of these results. 

3. Rational and irrational numbers 
3.1. When p and q are positive or negative integers, the 
number pjq is said to be a rational number. 
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A monotonia increasing sequence, (aj say, of rational 
numbers with a finite upper bound U must, by Theorem 4, 
converge to U . This number U may or may not be itself 
a rational number. Our fundamental assumption supposes a 
least number; it says nothing of a least rational number, and 
would be a false and foolish one if it did. If the number is not 
rational we call it an irrational number. 

As irrational numbers may come into mathematics when they 
are not obviously derived in this w r ay, w r e shall make an 
assumption, easily proved as a theorem when the theory of 
real numbers has been considered in full. 

Assumption 2.** Every irrational jiumber is the limit of a m.i. 
sequence of rational numbers. 

The proof is given in the appendix. 


Examples III 


1. Prove that ( a n ) is a monotonic decreasing sequence when a n is 
given by 

2. Prove that (a„) is a monotonic increasing sequence when a n is 
given by 


(i) 


ii’ 


(ii) 3 n 2 —n J r 2 f (iii) an 2 — 2bn-\-c, 


where a, b, c are independent of n, a > 0, and 3a > 26. 

3. Prove that an 2 —2bn J rC i where a > 0, increases with n once n itself 
exceeds (26— a ) / 2a. 

4. If (b n ) is a sequence of positive terms, and (a n ) is a monotonic 
increasing sequence, prove that 

°n+x(^i"r ^2 + — -f6„) > a 1 6 1 +a 2 6 2 + ...-fa n 6 Ji . 

Hence show that, if u n is defined by 

w n (&i + 6 2 +- + &n) = <*ibi+a 2 b 2 + ... + a n b n , 
then ( u n ) is a monotonic increasing sequence. 

5. A worked example. If a n+l = +V(fc+a n ), where k > 0, a 1 > u, 
then the sequence { a n ) is monotonic and converges to the positive root 
of the equation x 2 — x-\ -k. 

Let a be the positive root, —Jcja the negative root, of the equation. 
&n + 1 ==: h = (a n oc){a n -\-kj(x). 
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Hence, if a n > a, then a n > a n+l9 for a n +1c/a is positive; and if a n < a, 
then a n < &n+v 

Again, & + a 2 — &+a> 

and so a n+i a 2 = a n — a. 

Hence a n+1 > a if a n > a, and o n+1 < a if a n < a. 

Let cq > a; then (a n ) is a m.d. sequence and a n > a for all n; the 
lower bound of a n , say Z, > a, and a n -> Z as n~> co. 

Write a n = l + b n , so that 0. Then 

l 2 + 2lb n+1 + b 2 n+l = Z + 6 n -f& for all n, 
that is b n — 6^ +1 — 2Z6 n+1 = l 2 — l — k for all n. 

Since b n -> 0, we also have [pp. 36 et seq. consider such points more 
fully] b n — bl +1 — 2 lb n+1 — > 0 as n -> oo. Hence l 2 — l—k must be zero ; for 
if it were equal to y , where y # 0, then |b n --&| +1 — 2Z6 W+1 | would always 
be equal to \y\ and could not be made less than \y\ by any choice of n, 
which would contradict the statement b 7l ~b$ l+l -~2lb n+1 0. 

Hence Z is a root of x 2 = x-\-k, and is the positive root since Z > a. 

Similarly, if oq < a, then ( a n ) is a m.i. sequence and a n < a for 
all n; the upper bound of a n , say u, < a, and a n -> u. As before, we can 
show that u 2 = u-j-k, and so u, being positive, is the positive root of 
x 2 = x-\-lc. 

6. f If a n+1 = k/{l-\-a n ), where k > 0, cq > 0, the sequence ( a n ) con- 
verges to the positive root of x 2 ~\-x = k . 

7. Prove that, if a n+1 = a^ + k-r-k 2 , oq > 0, and a n tends to a finite 
limit Z, then Z must be either k or 1 — 

8. Let (a n ) be defined as above, with k > J and % > Prove that 
a n-fi > and hence show that a n — > +oo. 

f Examples 5 and 6 are taken from Bromwich, Theory of Infinite Series 
(London, 1908), p. 17. 



CHAPTER IV 

SERIES OF POSITIVE TERMS 

1 . Infinite series 

1.1. An expression such as 

u l J rU 2 J r->- J r f u> n -\- ... (1) 

is called an infinite series. 

Definition. The infinite series (1) is said to converge , to 
diverge, or to be non-convergent according as the sequence 

where s n = u^-j-u 2 +...+ u n , 

converges, diverges, or is non-convergent. 

If s n -> then s is called the sum of the series. 

1.2. There are a few series whose sums can be determined 
by elementary methods. Such are those given in Examples I. 
Most readers will be familiar with the geometric series, wdiich 
can also be summed by elementary methods. We shall need 
to refer to this series and so we formulate the following: 

Theorem 5. The geometric series 

1 +r+r 2 +...+r n ~ 1 +... (2) 

is (i) convergent when — 1 < r < 1 and its sum is then ( 1 — r)“ x ; 

(ii) divergent when r ^ 1 ; 

(iii) non-convergent when r ^ — 1. 

Proof. Let s n — l+r+.-.+r 71-1 . 

(i) Take any definite value of r between —1 and +1. Then 

1 r n 

Sjl \—r ~~ 1— r ’ 

1 r n 
— 

n x r x r 

By § 3, Chap. I, w^e can make \r n \, and so also \r n /(I—r)\, as 
small as we please by taking any n that is sufficiently large. 

Hence $ — . 

1— r 

Hence tne series (2) is convergent and its sum is (1 — r)~ x . 
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(ii) Take r = 1, so that now 

s n = n. 

The sequence s n diverges to +co. 

Further, if we take a definite r > 1, s n will he greater than n, 
and again s n diverges to +cc. 

Hence the series (2) is divergent when r > 1. 

(iii) If we put — r = y and make r < — 1, then y > 1. 

s n = 1 +r+...+r n ~ 1 

= i —y+y 2 +-+(—) n - 1 y n ~ 1 

_ 1 ) n + 1 y n 

1+2/ 

If n is even, == 2m say, then 

1— y 2m 

S n ~ *2 m l+y > 

this is zero if y — 1 and -> — oo if y has a fixed value > 1. 

On the other hand, if n is odd, = 2ra+ 1 say, then 
__ _ l+2/ 2m+1 

s n — s 2m+l T+y ’ 

this is unity if y = 1 and -> +oo if y has a fixed value > 1. 
Hence, when y = 1 the sequence s n is merely 
1,0, 1 , 0 ,..., 

and when y > 1 the sequence s n has two distinct sets of terms 
in it, one of which diverges to plus infinity and the other to 
minus infinity. In both cases the series is non-convergent. 

2. Series of positive terms 

2.1. Although there are comparatively few series whose 
sums we can obtain by elementary methods, there are extensive 
classes of series for which we can decide whether or not they 
have a sum, i.e. decide whether their s n tends to a finite limit or 
does not. It is with this problem that our work will be concerned. 

2.2. If u n is positive for all n the series (1) is called a series 
of positive terms. For such a series the sequence (s n ), where 

s n = U 1 +U 2 +... + U n , 

is monotonic increasing, since 

s n + 1 s n — u n+l > 
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Theorem 6. (i) A series of positive terms 

is convergent if a number K can be found such that 
s n = u 1 +u 2 +...+u n < K for all n. 

In such a case s n ->s < K. 

(ii) If no such number K can be found , then the series is 
divergent. 

(i) As we have seen, (sj is a monotonic increasing sequence. 
If a number K can be found such that s n < K for every n, 
then this mi. sequence has a finite upper bound s < K. Also, 
a m.i. sequence with a finite upper bound converges to that 
bound (Theorem 4). 

(ii) In this case the m.i. sequence (s n ) has upper bound -fco, 
and s n -> -fco (Theorem 4). 

Corollary 1. If %+^ 2 +... is a convergent series of positive 
terms and if s is its sum , then s n < s. 

For s n < s n+1 and, since 5 is the upper bound of the complete 
sequence (s n ), s n+1 < s. 

Corollary 2. If a series of positive terms 

n 1 +u 2 +-- 

is divergent , and N is any given number , then the series 

U N+1 + U N+2 + U N+Z + * * • 

is also divergent. 

From the theorem, a series of positive terms must be either 
convergent or divergent. If the second series were convergent 
we could find K so that 

^v+i+^v +2 +-+^v+p < & for all p. 

We could then say that 

s n = u 1 J r u 2 +... J r u n < ^+%+w 2 +...+^y for all n. 
Since the R.H.S. of this would be a definite number independent 
of n, the series . would be convergent. 

2 .3 . W e go on to consider various ways of finding out whether, 
in the case of a given series of positive terms, there is or is not 
a number K such that s n < K for all n. One of these ways is to 
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prove, by special procedure, that certain standard series are 
convergent, and then to compare other series with them. 

We conclude this chapter by considering one such standard 
series. 


3. A standard series 
3.1. Theorem 7. The series 

l~PJ r 2-p+3-pJ r ...J r n~v+... 
is convergent if p > I, divergent if p ^ 1. 

Let p > 1. Then , 1 9 

-i+i. < _ = 2 1 -*, 

2P 2 p 


1 + 1 + 1 + 1 <± 

4? 5P 6 p IP 4P 


8 




1-L.1+ _L. 1_ < — — 

15* 8 P 


(3) 


and so on. Hence the sum of the first 

1 + 2+4+.. . + 2™ = 2 m+1 — 1 
terms of (3) is less than 

l + 2 1 ~»+4 1 -*’ + ... + (2 m ) 1 -^. (4) 

If we write p = 1 + &, so that k > 0 and 2~ k < 1, (4) becomes 

1,1,1, i i_ ( i )m+v > 

" r 2*' 1 ~2 2A: " 1 ~"'" t ’2 m * 1— (£)* 

< 1/{1 -(*)*}• 

If w is any given number, we can choose m so that 
n < 1 + 2+4+.. ,+2 m , 

and hence, if s n is the sum of the first n terms of (3), 

+ < i/{i -an 

Since this last expression is independent of n, there is a number 
K, namely 1 /{I — (i)*}, such that 

s a <K for all n. 

Therefore, by Theorem 6,f s n -> a limit s + K. That is, the 
series (3) is convergent. 

f Instead of referring to Theorem 6, we may say that (s n ) is m.i., and so, 
by Theorem 4, s n - > s < K. Some teachers prefer the direct appeal to the 
properties of mono tonic sequences. 
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Now suppose p = 1, so that the series in question is 


Since 


and so on, 




Hi >2.i = A 

i+i+m > = i 

Hl’o +■••+* > 


1 
2 > 


1+ r(ri + "' + (j 


QM-l ; 1 1 


> l + -|?7l. 

Now (6) contains the first 

l_]_l_p2+2 2 +...+2 7n_1 


2 m 


(5) 


( 0 ) 


terms of (5). Hence, if is the sum of the first n terms of (5), 
s n > 1+im when n > 2 m . 

If we put down any positive number A, we can choose an integer 
m so that 1-f ira exceeds A. Then, if we take n ^ 2 m , s 7) exceeds 
A. Hence the series (5) is divergent. 

Finally, if p < 1, then 

n~ p > n~ l . 

Hence s n = l~^-f 2“^ + 

> l + 2-M-...+n- 1 , 


and whatever positive number A we put dow r n, s n w r ill exceed A 
if n ^ 2 m and m is chosen so that l + > A. Hence the 

series (3) diverges if p < 1. 

3.2. Alternative proof of Theorem 7. Theorem 7 may also 
be regarded as an example of the integral test (Chapter XIV). 
The use of the integral test provides the simplest proof of the 
theorem. But this proof uses properties of logarithms and 
theorems in the calculus that w r e do not wish to use until we 
have obtained an independent development of them. If w r e 
used the integral test now, we should be in danger of employing 
Theorem 7 to develop later theorems upon which the properties 
of logarithms will depend — our argument v r ould then complete 
a circle. 

At this stage, n~ v is defined only for rational values of p ; 
when r and 5 are integers, n~ r!s = 1 
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THE COMPARISON TEST; THE RATIO TESTS 
1. The comparison test 
1,1. We shall, from now on, use the notations 

GO 

2 «». 2 u n 

71 = 1 

to denote the infinite series 

%+^2+---+^n,4" 

In this section we compare two series u tv 2 v n> wherein 
each u n and each v n is positive. 

Theorem 8. (a) If 2 v n is a given convergent series of positive 
terms whose sum is V, and the terms of 2 u n are such that 
0 < u n < Kv n for all n, 

where K is a fixed positive number , then 2 u n is convergent and 
Us sum < KV . 

(b) If2Vn is a given divergent series of positive terms, and 
the terms of 2 u n ar £ such that 

u n ^ Kv n for all n, 

where K is a fixed positive number , then u n i s divergent. 

Proof {a). If a n = v 1 J r v 2 +".+v n , then cr n is a monotonic 
increasing sequence: by the hypothesis that v n has the sum 

< V for all n. 

Accordingly, by the hypothesis that 

u n < Kv n for all n, 

s n = (% + < W 2 +”* + '^n) ^ -^(^1+^2+ ••• + v n) 

= Ko n 
<KV. 

But (s n ) is a m.i. sequence, and so (Theorem 4) s n ~>s < KV . 
That is, 2 u n convergent and its sum < KV. 

Proof (b). With the above notations s n , a n we now have 

Sn ^ Ka n . 

By the hypothesis that 2 v n divergent, cr ?l increases indefi- 
nitely! an( i hence s n does also. 

| Compare the definitions in Chap. II, § 4.1. 
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Examples IV 


1 , The series 2 ( n ~r l )~ 2 
divergent. 

Hint. 


is convergent, the series 2 (3ft— l)" 1 is 

1 ^ 1 
(n + %)- < Ji 2 ’ 


and (Theorem 7) 2 n “ 2 is convergent. Put u n = (n*f J) 2 , = n“ 2 , 

and Jv = 1 in the theorem just proved. Again, 


1 _ 1 _ 
3n— 1 ^ 3 n 


and (Theorem 7) 2 n ~ 1 divergent. Put u n = (3n — 1) 1 , v n ~ n 1 , 
and K = J in the theorem just proved. 


2. The series 

V 1 

n 

Z,(2n-j-l) 3 ’ 

A(3n + 2f 

are convergent. 



3. The series 

n 

v L. _ 

2L,( 4n-l) 2 ’ 

A,(2n-l)V 2 

are divergent. 




1.2. The test in its practical form. In working most 
examples that can be made to come within the conditions of 
Theorem 8 it is simpler to use Theorem 9, which we shall now 
prove. We begin with a lemma that extends the result of 
Theorem 1. 


Lemma. If each term of the sequence (oc n ) is positive and 
cc n a finite positive number a, then there are positive numbers 
H , K such that 

H < 0 L tl < K for all n. 

Since a R -> a, 

c > 0; 3 N . |a — <x n \ < e when n ^ N. 

Let N x be the value of N when we take e = fa > 0. Then, 
when n ^ N lt |a— aj < fa, and so 

a— fa < ot n < a-ffa. (1) 

From the finite set of positive numbers 

a l> a 2’***5 a A\-l 

we can choose a least (or equal least) and a greatest (or equal 
greatest): let their respective values he h, k. Then we have 

0 < h < oc n < k (n=l,2,...,N 1 —l). 
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If we now choose positive numbers H, K so that 
H is less than h and fa, 
an d K is greater than 1c and fa, 


then 


0 < H < ca n < K for all n. 


Theorem 9. If 2 u n> 2 v n are iwo series of positive terms 


such that 


u, 


^ -> L > 0, 


then the two series are either both convergent or both divergent . 

The number L must be finite and not zero in all applications 
of this theorem . 

Proof. By the preceding lemma we can, if 




0 , 

determine positive numbers II , K such that 


H < — < K for all n, 

v n 

that is, such that Hv n < u n < Kv n for all n. 

Hence, by Theorem 8 (a), if 2 v n converges, so does 2 and, 
by Theorem 8 (6), if 2 v n diverges, so does 2 ?V Since 2 v n must 
either converge or diverge, this proves the theorem. But if L 
is zero, we cannot use the lemma and the argument fails. 

1.3. It is clear, from the proof, that Theorem 9 is a particular case of 
Theorem 8. It is a most useful practical form of Theorem 8, as the 
following examples will show. On the other hand, from a theoretical 
point of view. Theorem 8 needs to be mentioned explicitly because it 
is not completely covered by Theorem 9. There is no theorem that says 
‘because u n \v n remains less than a fixed number K for all n , the sequence 
( u J v n) will converge’, and so Theorem 8 covers a wider ground than 
Theorem 9. Moreover, in theoretical questions (cf. Examples VIII) it is 
Theorem 8 rather than Theorem 9 that is useful. 


Examples V 

[Defer the harder examples until pp. 36-38 have been read.] 

1. Prove that 2 u n I s convergent when u n has any one of the values 
n+l m+1 n 2j rn— 1 n 2 +n- 


n 3 + 2* n 3 — 2* 

(n 2 +n— 1)* 
(n 5 - 2 )* ’ 


-1 

i 4 -3n* + l 9 


n 4 + 5n 2 — 6 
n 6 +ll ' 
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2. Prove that 2 u n is divergent when u n has any one of the values 

n-r 1 n — 1 n 2 -}-n — 1 n 2 -j~n — 1 

n 2 + 2 ’ n 2 — 2’ n 3 ' n 3 -}-3n 2 — 1 * 

(n 2 +n— 1)* n 4 + on 2 ~~ 6 

(n s ~^2)* ’ n 5 -fll * 

Method for Examples 1 and 2 . Consider the first example, 
u n = (n-rl)/(n 3j r2). 

We see that u n is ‘about as big’ as l/n 2 (compare Examples II), and so 
we put v n = l/n 2 , when u Jv n -> 1. 

Apply Theorem 9, with v n — l In 2 . 

3. Prove that if 2 v n is a convergent series of positive terms, u n > 0, 
and ujv n ~> 0, then 2 u n is convergent. 

4. Prove, by considering the particular case 

u n = n~ 2 , v n = ?i~\ 

that if 2 u n is a convergent series of positive terms, v n > 0 and 
u n !v n —> 0, then 2% is n °t necessarily convergent. Give an example 
to show that it may be convergent. [v n — n"*.] 

2. The ratio tests 

2.1. D’Alembert’s and Raabe’s tests. When we can 
neither make use of Theorem 9 nor see fairly readily, by 
examining the form of u iv -whether 2 u n converges, we use 
Theorem 10 and if that fails, as it will when {u n /u n+1 ) -> 1, 
Theorem 11. 

Theorem 10. 2 u n i s a series of positive terms: 
if ffjL. l > 1 3 then 2 u n is convergent; 

u n+l 

'll 

if — _> l < 1, then 2 u n is divergent . 

u n+l 

This is often called d’Alembert’s test. 

Theorem 11. 2 u n is a series of positive terms : 

if — 1 J -> l > 1, then 2 u n is convergent; 

\ u n+i / 

-> l < 1, then 2 u n is divergent . 

This is often called Raabe’s test. 
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2.2. These and other special tests involving the ratio uju n+1 
can be proved, each one separately. But the problem of the 
ratio tests goes rather deeply into the theory of convergence. 
When, in the history of our subject, various tests had already 
been devised, two facts were discovered. One was that however 
far the line of successive ratio tests w T as carried it could never be 
exhaustive; it would always be possible to write down a series 
2 u n whose terms were such that no one of the tests already 
established could say whether 2 u n were convergent or not. 
This point we shall not pursue as it would take us too far 
afield. 

The other fact was that most of the proofs of known tests 
ran along the same lines. Accordingly, a general test was 
devised from which the special tests could be deduced. This 
general test — or rather one that is a little short of it in generality 
—we now give. 


Theorem 12. Let a divergent series of positive terms 

iw - 1 

be given , and let the terms of a series of positive terms 2 u n 


such that 


XL 


-R 


71+1 


L. 


Then 


u n + 1 

2 u n is convergent if L > 0, 
2 is divergent if L < 0. 


Proof (a). Suppose first that, with a given divergent series 
of positive terms 2 (A)” 1 ? the terms u n of the series to be 
investigated are such that 


XL 


Jfn 


■ R 


71+1 


-> L > 0. 


Then, 3 N . for all n > N 


D n -^-D n+1 >iL (1) 

^ 71+1 

(compare Chap. II, § 6). Since u n+1 is positive, we may multiply 
throughout by u n+1 and keep the inequality sign (if it were 
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negative the inequality sign would be reversed after the 
multiplication and become <C). Hence, when 71 ^ N , 

D n u n D n+ i u n+1 ;> \Lu n + 1 * 

Write clown this inequality for n = N, N+l,..., m—I (> A r ), 
and add: we get 

D s U x —D m U m > JA(w v +l+%'+2+”-+ w m)- 

rn N 2 

Hence = 2 < 2 + y -Dy 

But, since N is a definite fixed number, the R.H.S. is fixed and 
definite. Denote its value by K, say. Then, for all m, 

s m < K. 

Hence, by Theorem 6, j s m -> s < K and u n is convergent. 

Proof ( b ). Next suppose that the terms u n of the series to be 
investigated are such that 

D -V— D ft+1 -*£< o. 

u n+: 1 

Then (compare Chap. II, § 6) 3 N . for all n ^ N 

< 0 , (2 ) 

^71+1 

Dn u n ^ -Ai+l^n+1* 

^ 2> v+1 ^V4-i ^ 

w r > -t D v w v (r > A r ). 

u r 

Accordingly, if m > A 7 , 

m N j 

«m = 2 U r>1 u r + D .w u .\ > 7T • 

7=1 ?• = 1 ^ jL) 

r = A + 1 

But, by hypothesis, 2 (AJ -1 is divergent and so s m is a mono- 
tonic sequence that increases indefinitely. Hence 2 u n * s 
divergent. 

2.3. The theorem enunciated is all we need to know if we have in 
view its application as a test to any series ^ u n that we may encounter. 
But we have, in fact, proved rather more than we have enunciated. 


and so 
Hence 

and 


t Or, since (s n ) is a m.i. sequence, s n -* s < K, by Theorem 4. 
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In ( a ) we have nowhere used the divergence of 2 T)" 1 ; our work in 
the latter half of (a) is easily rewritten so as to prove the theorem : 

jf J Dn 1 a ser ^ es °f positive terms , divergent or not , and there are 
positive numbers h , N such that 

D n u n —D n+1 u n+1 > ku n+1 > 0 when n > N, 
then 2 u n i s convergent. 

In (b) the latter half of our work proves the theorem : 

If J AT 1 a divergent series of positive terms, and there is a number N 
such that q < D nUn ^ D n+1 u n+1 when n > N, 

then 2 «n is divergent . 


3. Proofs of Theorems 10 and 11 

3.1. In Theorem 12 put D n = 1. If 

— then 3 l l+£, 

M ?i+1 ^n+l 

and Theorem 10 follows. 

Note. If, as sometimes happens, «„ < u n+1 for all values 
of n, then the series 2 is clearly divergent. For, in such 

db C2LS6* I i i 

+ ^ nu V 

U 

This fact is useful for remembering that it is — l 

u n + 1 

LESS THAN ONE WHICH GIVES DIVERGENCE. 

3.2. In Theorem 12 put D n — n. If 

n—l -> L, then n(~ ■ — l)->L+l 5 

^71+1 l^rt+l 1 

and Theorem 11 follows. 


4. A simple explanation of Theorem 10 
4.1. 'The following considerations led to the discovery of 
Theorem 10 and also help one to remember it. 

If u n /u n+1 L, then, when n is large, u n+1 is 'about the same 
as uJL , u n+ 2 about the same as uJL 2 , and so on: the terms of 
the series 2 u n are, once n is large, roughly the same as those of 

u n {l+L-'+L-*+...)\ 

Hence L > 1 will give convergence, L < 1 divergence 
(Theorem 5). 
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Theorem 10 can, in fact, be proved by refining the above 
rough idea into a precise argument. 


Examples VI 

1. Prove that each of the series 

2 <”+«*■■ IS!**. Is+^is 


(n- fl) 


3) 

1 (Theorem 9). 


converges when 0 < x < 1, but diverges when x 

2. Prove that the series 

, a.h , a(a-f-l)&(&-f 1) _ , _ 

+ c.d x ' c(c+l)d(d+l) X + ‘” ( - a ’ h ’ c ’ d > °) 

converges when 0 < x < 1 (Theorem 10), that it converges when x = 1 
provided that c-\-d > 1, and that it diverges when x = 1 provided 

that c-fd < a-j-5-fl (Theorem 11). 

3. Prove that each of the series 

1+*+— 4-5-4-. .. 

^2! '3! 
x 3 x 5 

x +j ] +j ] +- 

converges for all positive values of x. [Use Example 10 (i).] 

4. Show that 2 n\x n cannot converge for any positive value of x. 

5. Show that the series 2 n k % n converges when k is any fixed number 
and 0 < x < 1. 

6. Show that the series 

, , a a-f 1 . , a-j-2 , 

1 + S* + TT * ,+ 01*'+- ( a >°) 

converges for any positive value of a:, and that the series 

(a > 0 ) 

also converges for any positive value of x. [Use Example 1G (i)]. 

7 . Show that the series 

1+ f*+^r^*'+- ( a > 5 > °) 

converges when 0 < x < b and diverges when x > 6. 

8. Show that % (a-\-n)x n /(b-{-n) is convergent when 0 < x < 1, 
divergent when x > 1. 

9. Prove, from § 2.3 or otherwise, that £ «» is divergent if u n > 0 and 

either (i) u n < « n+l , or (ii) n{(uJ Un+1 )- 1} < l, 
when 7i > a fixed iV. 
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10. Prove, from §2.3 or otherwise, that 2 u n is convergent (i) if 

[Un! u n+ 1 ) ^ ' n {( u nl u n+i) ~~ >m °Oj (iii) if either of these expres- 

sions is always greater than a fixed number k, itself greater than unity. 

11. Discuss the convergence of the series 


. , , , 1.3. 5. 7 „ 

+ o.8.n a: + -- 


12. Prove that each of the series 


y i - 2 -* y i • 2...(n+ 1) 

4 3. 5...(2n-j- 1) * 3.5...(2n-l)' 

converges when 0 < x < 2 and diverges when x > 2. 

13. Prove that each of the series 

V l-2.„n , n NT 1 . 2.,.n 

i 5 . 7...(2n-f- 3) 9 jL ~4 7. 9...(2?i-f-3 ) X 

converges when 0 < x < 2 and diverges when # > 2. 

14. Prove that the series 


2 1.2 
4.7 ...( 


^ 4.7...(3n + 1) 

converges when 0 < x < 3 and diverges when x > 3, and that 

y 1 •*•••" a n 

^ 7.10...(3n+4) 

converges when 0 < x < 3 and diverges when x > 3. 

15. Construct series that 


(i) converge when 0 < x < 4 and diverge when x > 4; 

(ii) converge when 0 < cc < 4 and diverge when x > 4. 
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THEOREMS ON LIMITS 

1. Limit theorems 

1.1. The following formal theorems on limits have been 
deferred as long as possible. They will be frequently used from 
now on. 

Let two sequences (/3 ri ) be given; let 
oc n —>■ a, {3. 

Then oc n fi }t — > a /3, 

aJPn, -> a/j8, provided ft # 0. 

The proofs are as follows: 

By definition (Chap. II, §2) oc n — a->0, that is, 

oc a — a and can each be made as small as we please 

by taking any n that is sufficiently large (form A of definition). 
Hence (oL n ±f3 H )— (aijS) can each be made as small as we 
please by taking any n that is sufficiently large. 

1.2. Using form C of definition, we may write the proof thus: 

e > 0; 3 Ai , ja w — a\ < le when n > X x> 
a^d 3 N 2 . ]/3 n — < $€ when n > X. 

Let A T exceed both and A T 2 . Then, if n > N, 

\(a n J r^n) — (oc J rP)\ < |a w — a| -f < e. 

Hence 

e > 0; 3 A r . — (a-bj8)| < € when n > N, 

and this proves that a n -fj8 n — > a-f/3- 

1 . 3 . Again, it is easy enough to see, in a rough sort of way, 
that if 0 L n approaches (Chap. I, § 2) a, and fi tl approaches /3, then 
their product oc n fi n approaches a/3. We now give a careful proof 
of this. 

2. A useful detail of technique 
We want to show that 

e > 0; 3 A 7 . ja/3— a n /?J < € when n > X, 
that is to say, putting down any positive e to begin with, we 
can then find N such that, etc. 

It is found, by experience, that in exercises of this sort it 
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pays to put down two arbitrary positive numbers, € and k, to 
begin with and then later on to give k a definite value. 

In the present exercise the detail is as follows: 

Since a n -> a, j3 n p, it follows that 

e, k > 0; 3 N ± . |a— oc n \ < c/i when n ^ A T 1? 
and 3 A T 2 . |j8— p n \ < ejk when n > N 2 . 

(Notice that vre have put e/k instead of e in form 0 of the 
definition of convergence; Chap. II, §2.) 

Let N exceed both N x and N 2 Then, when n ^ N , 

i a 0— « n 0J = WP~ 0«)-rP«(a— «n)l 

< l«(^-Ai)l+l^n( a -“n)l 

< J{[«]+|js n |>. 


But the sequence (/3 n ) is convergent and therefore (Theorem 1) it 
is bounded; that is, there is a number K such that 

\P n \ < K for all n. 

Hence, when n ^ A, 

W-«nPn\ < pk|+A'}. 

Now give k a definite value greater than K+ and we have 
at once |a/J— a n j8J < € when n ^ N. 

We have thus proved that 

e > 0; 3 N . |aj8— a a j8 w | < e when ft ^ A". 


2.1. We now prove the last of the four results stated in § 1, namely, 
if <x n -+ a, P n -> P # 0, then aJP n -> a/p. 

Let c, A;, A x , A r 2 be the numbers in the beginning of § 2. Then, when 
n > A x and A T 2 , 


P fin 


1 [ 
# J 


l“(0»— 0)— ^(o£»— “)| 


< 


08. 




Since j8 n — > p ^ 0, it follows that |j8 n |— > |j8| > 0 (see Examples II, 7). 

Let 0 < H < |jS|. Then \p n \ > A when n > a certain M and, if A 
exceeds A r x , A\>, and M, 


.0 


1 {|(*1 + | 0 |>c 

**101 * 


when n > A. 
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On choosing k > [jot! -f we have 


\P 


< € when n > X. 


Xote that we could not choose h if |jS| were zero. 

Corollary. If cl u -> oc, o^-fH -> a+H; -> Ax; etc. 

2.2. Method for Examples II. These limit theorems provide 
a simple procedure for proving the results that were proved in 
an elementary, but not very simple, way in Chapter II. 

The reader will readily prove for himself that 


Hence 


n r 


an r bn 1 "- 1 - 


' , h , h 
^ n n r 


• alx unless a is zero. 


We work two typical examples from Examples II. 

?t 3 — I xn'rfijl \ 7i 3 ) 

The numerator -> 0, the denominator — > I. Hence 
(?z 2 -f- 3 )/(tz 3 — I ) 0. 


3 + -->3, 
n 


and so 


3 

n 2 — 5n 


3. Some theorems about infinite series in general 

3.1. It follows at once from § 1 that, if each of the series (not 
necessarily series of positive terms) 

u 1 +u 2 +-, v ± +v 2 +... 

is convergent, their sums being U, V respectively, then the 
series / . \ / , \ , 

( U 1 + v l ) + (^2 + ^ 2 ) + * * * 

is convergent and its sum is U+V (Chap. IV, § LI, Definition). 
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Similarly, 2 ( u n~~ v n) b e convergent and have the 

sum V — V . 

3.2. On the other hand, 2 ( u n~’ v n) or 2 ( u n J r v n) ma y be con- 
vergent when both 2 are divergent. Thus, we can write 

2 ^n) = 2 2 2 = 2 U n~ 1“ 2 

only when we know that each of u n , 2 ^ * s convergent. We 
shall come back to this point in the examples. 

3.3. Theorem 13. //, for a given ra, the series 

u m+l J r u m+2 J r-'‘ (!) 

is convergent , then the series 

+ ( 2 ) 

is also convergent. If (1) has the sum s , then (2) Aas the sum 

Ui J rU%-\-... J rU m -\-s. 

Let denote the sum of the first n terms of (1) and a n the 
sum of the first n terms of (2). Then, when n > ra, 

a n = V-m+(%+^2+**-+^ m )* 

Also, since m is a given number, n—m -> co as n -> oo. 

If (1) has the sum 5, then -> 5, and so s n _ m -> 5 as n -> oo. 
Hence cr^ — > 

3.4. One of the occasions when Theorem 13 is useful is in 
dealing with series of the type w T e now consider. 

Suppose that the series 

%+%+••• 


is not one whose terms are all positive, but is one whose terms 
are all positive after the rath term, where m is some definite 
number. We shall speak of such series as one whose terms are 
ultimately positive. (In examples it is rarely of interest to 
know the value of ra; we merely want to know that, sooner 
or later, such a value of m does occur.) We can apply to the 
series 


1 " 


+ ^m+2+*** 


the tests for convergence for positive terms and so, 


Theorem 13, Corollary. We can apply the tests for series of 
positive terms to series whose terms are ultimately positive. 

The following worked examples illustrate some of these points. 
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Examples VII 


I. Discuss the convergence of the series 

x-l , (x-\)(x-2) (x-l)(x-2)(x~Z) 

IN ‘ r 21 3! 


for all real values of x. 

In the first place, the series terminates if x is a positive integer. The 
question of convergence does not then arise. 

Suppose now that x is not a positive integer. The nth term of the 
series, u n say, is given by 

' _ , lr _ 1 (ar-l)(-r-2)...(^-w-f 1) 

1 (n- 1)! 


Then 


u n __ n __ n 
u n+ 1 x — n n—x* 


Hence u n and u M have the same sign when n > x. That is, the terms 
are ultimately one-signed. If they are ultimately positive, we can apply 
the ratio tests. 

If the terms are ultimately negative, say u n < 0 when n > m, then 


u m+i ~T u m+i "T • • * 

is convergent if (— u m+l ) + (— w m+2 )-f ... is a convergent series of positive 
terms; for if $ n — > $ then — s n -> —s. 

( u v ) u n 

( u n+l) u n + 1 

so that the ratio tests of Chapter V can be applied without change to 
series of negative terms, or to series whose terms are ultimately negative. 

Hence, when the terms of a series are ultimately one-signed we can 
apply the ratio tests. 

For any fixed value of x, not an integer, 

fanfan+l) > 1 

and so Theorem 10 tells us nothing. We try Theorem 11: 



Hence the scries is convergent if x > 1 and is divergent if a; < 1. 


2. Show that 


n=l 

2n+ 1 


2k + 1 
n 2 (n-i- 1 y 


= 1. 


2 hi XT f 1 1 1 

n 2 {n-\-iy £-4 Ui 2 (K-f-1) 2 /* 

n — l n — 1 

Each of the series 2 n~ 2 , 2 (n+ 1)“ 2 is convergent and so we may write 
the last expression as 


( 1 +^ + 55+-)-(4 + p + -)- 
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By Theorem 13, the first of these is 

An alternative method which avoids the minor difficulties. 


2m-{- 1 
n 2 (n-j- 1) 




( 1 1 
i n 2 (n-f-1) 2 


~(N+ 1) 2 ' 


Hence the sum of N terms of the series -> 1 as N -> oo; that is. 


n 2 (n+ 1) 2 


In all similar examples this is the simplest method to use. 


3. Show that 


n(n+ 1) 


Since 2 n ~ 1 is not convergent, it would be nonsense to say 


oo co 

V- i =y(i u 

11 = 1 71=1 

00 00 

= yi-f JL 

As n A, n + 1 


n= 1 n=l 


= (l+i+J+«**)—(i+i+—) = L 

The separate brackets 1 4* J +£ + ••• and £-}-& + ••• look right enough, but 
they can have no meaning since these series are divergent. 

But the method of dealing with N terms is quite sound, and gives 

y - 1 — , yli i_) = i i >i. 

aL, n{n~ fl) Zt\n n- f- 1/ N + 1 


Further Examples 

4. Show that 2 {(n-j- X^+f)} -1 = |. 

n = 0 


5. Prove that 


00 1 CO 7 

2 -2 ^ 2 (n+i)* 


6. Prove that 


2 {»(n + 1)}" 3 = 10-7T 2 . 

W = 1 


[Assume that 2 ^” 2 == ^tt 2 .] 

7. Discuss the convergence of the series 

2 (— l) n n\[x(x— I).. .(a;— n + 1) 
i 

for all real values of x. (Cf, Example 1.) 
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3.5. .4 necessary, but by no means sufficient, condition for the 
convergence of an infinite series. 

Theorem 14. If the series ]> ««, * s convergent, then u n -> 0 
as n -> x . 

Given only that u„ -> 0, it does not follow that the series 
T u n is convergent. 

Let s n = u 1 -fu,+ ... J r u„. 

Then, since 2 * s convergent, s n -> some finite number s as 
re -> cc . Equally, •s r< _ 1 -> s as » oo. Accordingly, by § 1, 

«« = s n -s n - L -^s-s = 0 . 

On the other hand, 



is a divergent series, although w -1 -> 0. 

Examples VIII 

1. If 2 is a convergent series of positive terms, so also is each of tlie 

series 2 «4> 2 

Since 2 Un convergent, 0 as n-> oc. Hence (cf. Chap. II, 5 6) 
3 X . 0 < < 1 when n > A r . Accordingly, when n > A T , 

and w n w n+ i are each less than u n . 

The results follow from the comparison test. 

2. If 2 u n is convergent, then 2 ( u n —u n+1 ) is also convergent and its 
sum is u v (Consider the sum of N terms.) 

3. Prove that if a n > 0 and if 

» 0, then a n 0. 

1 -r a n 

By hypothesis (ef. introduction to § 2) 

e, k > 0; 3 A 7 . -~ n - < - when n > N. 

I -ra n k 

Hence, when n > A T , a n (k~e ) < e, 

or, on giving k the special value X -f e, 

a n < 

Hence, € > 0; 3 A 7 . a w < e when n > A T . 

(We put down two arbitrary numbers e, it to begin with, and, at 
our convenience, make a special choice of k : this leaves the one number € 
arbitrary, and so our final statement is : ‘ On putting down any arbitrary 
positive number e to begin with, there is a number N such that a n < e 
when n > A".’) 
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4. Prove that if a n 0, then a„/(I-f a n ) -> 0. 

If a n — > 0, then 1-f a n -> 1 and (§1) their quotient -> 0. 

5. Prove that if a n > 0 and if one of the series 

2 a «> 2 a J( 1 +°*) 

is convergent, then so is the other. 

Hint. If the second series converges, then 1-f a n -> 1 and l-f-a n < -| 
when n is large enough. Use comparison test. 

6. If one of the series in Example 5 is divergent, then so is the other. 
Hint. First solution. A series of positive terms must either diverge 

or converge. 

Second solution. Unless a n /(l-f a n ) — > 0, a n cannot— > 0, and neither 
series can converge. 

If a n —> 0, then 1 < l J r a n < § when n is large enough. Use com- 
parison test. 

7. Prove that in Examples 3-6 1-f a n can be replaced by c-f a n , where 
c > 0. 

8. If c > 0, a n > 0, prove that the series 

2 “n 1 . 2 K+c) -1 

are either both convergent or both divergent. 

Hint. Either a n -> oo or it does not. Consider each case. 

9. If 2 u n = s, 2 u\ = S, 2 u n u n+ 1 = or, and u n > 0, prove that 

s 2 > S f s 2 > 2cr . 

10. Give examples to show that 2 u n ma y diverge while V u\ con- 
verges. 

11. If u n > 0 and 2 u n is convergent, with sum s, prove that 

u n 2u n 

Wi+...+W a ^ 

when n is sufficiently large. Hence prove that 2 w n/( w i + '“ + w n) is 
convergent when 2 is convergent. 

12. Pringsheim’s theorem. If u n > u il+1 > 0 and 2 u n i g con * 
vergent, then nu n -> 0. 

Let 5 be the sum, and let s n s= tq-f ...-f u n . 

Then s n -> s and also s 2n -> s. Hence 

w n+i + --* + w 2u -> 0. 

But u n+1 > w jh _ 2 > ... > w 2n , and so nu 2n -> 0. Hence 

2nu 2n — > 0. 

But « 2n+1 < w 2 n» so that we also have 2?iu 2n+1 -» 0, and finally, since 
{(2»+X)/2»}-*l, (2n + l)u 2n+1 -> 0. 
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13. In Example 11, if 2 11 n I s divergent, then so is 2 n u 's a , 
Sul ni Ion. If u < in , then, since s a — %-r — -fW/i an d is ni.i.. 


^ __ 1 

^//4 

If 5 rt -* x as — > x, ilie last expression — ** 1 as m — > x when e is 

fixed. 

Hence, with any given e, we can find an m such that 

%i_ - 1 

and X * u n ' 8 a) consists of blocks of terms wliose sums each exceed -J-. 


4. Further tests for series of positive terms. Cauchy’s 
test 

4.1 . Theorem 15. If u /t is always positive and \ : u tl -> L. then 
the series 2 ^ convergent when L < 1, divergent when L > 1. 

Proof, (i) Let L < 1, and let be any definite number 
such that Z < L x < 1. Then (compare Chap. II, § 6) 

3 X" . \’u n < L x when n ^ X, 
i.e. u H < L\. 

But, since L x < 1, the series 

tx i r.v+i_]_ 

Li “... 

is convergent, and so. by the comparison test, 

^v+w v +i+- 

is convergent. 

Hence (Theorem 13) 2 is convergent. 

(ii) Let L > I. Then 

3 X r . \’u n > 1 when n > X". 

That is, u n > 1 when n > X 7 , so that does not tend to zero. 
Hence (Theorem 14) ]T n °f convergent. But a series of 
positive terms must either converge or diverge, and so 2 u n 
is divergent. 

Corollary. If a n > 0 and 1 \ja n -> R~ 1 i then ^ a n x n is con- 
vergent ivhen 0 < x < R. 
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5. The condensation test 

5.1. TH.OBEM 16. If #(») > 0 and , U seqilmc , ... js 
monotomc decreasing , then the two series 

CO O0 

2 #*)> 2 hn ^ hn ), 

n — 1 n = 1 

wfere A « « integer greater than unity , converge or 

diverge together. 1 " 

Since </>(n) is m.d., we have 

<f>{h)+4>(h+l)+...+ < f,(h 2 -l) ^ {h*—h)<t>{h), 

(f>{h 2 )-\-(f>(h 2 -\-l) — 1) ^ (^3 — h 2 )<f>(h 2 ), 

By adding these inequalities we get 

<£ (&)+</> (A + !) + ••• J r(j)(h n+1 — 1) 

^ (h-~ l ){h<f>(h) + h 2 cf>(h 2 ) -f . . . + h n <f>(h n )}. 

Suppose that £ h 7l <f>(h n ) is convergent and has the sum S. 
Then (Theorem 6, Corollary 1), for all values of n, 

h<f)(h)^h 2 <f>(h 2 )-^ ...-\-h n <f>(h n ) <; 

Hence, whatever the value of m, 

^(7i)+<^(A+l) + ...+^(A+m) < ( h — 1)$ 

(we can choose n to make ^ n+1 — 1 > h+m), and the con- 
vergence of 

follows. 

Again, on making a slightly different start so as to reverse 
the inequality signs, we have 

<j>{h+l)+</>(h-]~2) J r ...+ <f>(h 2 ) > {h 2 —h)cf>(h 2 ), 

<t>(h 2 +I)+cj)(h 2 +2) + ...+(j>(hZ) > (h z —h 2 )<f>(h z ), 

By adding these inequalities w r e get 

^(^+l)+^(A+2) + ... + ^(^ n ) 

> {(^ — 1 (^ 2 ) (^ 3 ) H- - . . + 
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Suppose that f^h n (j>(h n ) is divergent. Then, as the last 
inequality shows, the sum 

increases indefinitely. Hence J <j>(n) is divergent. 

We have thus shown that the convergence or divergence of 
2 h n ^{h 11 ) implies the corresponding property for 

Also, if 2 is convergent, then 2 h n (f>(h n ) cannot be 
divergent, for if it were, 2 <f>{ n ) would be divergent also; and 
if 2 is divergent, then ^ h n cj>(h n ) cannot be convergent. 

5.2. The condensation test is particularly well adapted to 
series that involve logarithms. 

For the benefit of those readers who want the principal results as soon 
as possible we give here a theorem involving logarithms. We shall not 
use it in this book until after our own treatment of logarithms. 

Theorem 17. The series 

CO , 

y 1 

Z*n(log n) k 

is convergent if h > 1, divergent if k ^ I. 

If (f){n) — l/n(log n) k and h > 1, then 

h n 6(h n ) = — = . 

h n (n log h) k n k ( log h) k 

Theorem 17 now follows from Theorem 7. 

Examples IX 

1. Show that the convergence of X rr k when k > 1 follows from the 
convergence of X r n when r < 1. 

2. Show that X (nlogTiJ-qioglogn) - * 1 is convergent if k > 1, divergent 
if & < 1. 

3. Find for what sets of values of a , 6, c the series 
X n a (logn) h (loglogn) c 


is convergent. 



CHAPTER VII 
ALTERNATING SERIES 


1. Alternating series 

1.1. There is one type of series other than series of positive 
terms for which it is easy to decide whether or not it converges. 
This type is (1) 


where each u r is positive. Such a series is called an alternating 
series, because the signs alternate. 


Theorem 18. The alternating series (1) is convergent if 
(i) u n is monotonic decreasing , i.e. u n ^ ^ n+1 , 
and (ii) u n 0 as n -> oo. 

We prove this theorem by considering separately the sum of 
an even number of terms and the sum of an odd number of 

terms - S 2n = («!—«.)+. -+(w 2 „_ 1 — w 2n ), 

and so, by hypothesis (i), the sequence 

s 2 , s 4 , s 2n ,... (2) 

is m.i. (monotonic increasing) ; but we may write 

S 2n = U 1 ( U 2 u s) *•* -2 U 2n- 1) ^2/u 

so that s 2n is never greater than u 1 . Hence (Theorem 4, 
Corollary 1) (3) 

Next consider an odd number of terms. We have 


°2n+l 


— U^ (u 2 uf) ... (u 2 n 


( 4 ) 


so that the sequence 0 „ 0 

*3? '**3 6 2»+l3* 

is m.d. (monotonic decreasing); but we may write 

s 2 7 h-i = (u 1 -u 2 )+(u z —uJ + ... + {u 2n _ 1 --u 2n )+u 2n+v 
so that s 2n+1 is never less than u 1 —u 2 . Hence 

8 2n+l~* L ' > U x —U 2 . (5) 

Accordingly, without using hypothesis (ii), we have shown 
(A) that the sequence formed by the sums of an even number 
of terms Q Q , 

*23 *4’ * 2ti3 * * • 

is m.i. and converges to a limit between u ± —u 2 (= s 2 ) and u x ; 
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(B) that the sequence formed by the sums of an odd number 
of terms 

•••> *2n-rlv 


is m.d. and converges to a limit between u x (= sj and %— u 2 . 
Since s 2n -» L, « 2n+1 -> L', we have (Chap. VI, § 1) 

u 2n~l “ S 2n+1 S 2n L —L. 

But, by hypothesis (ii), u 2n+1 -> 0 and so X' = L. That is to 
say, both the sequences tend to the same limit L. 

Hence s n -> L as n oo through all values. 

Formally, the last step in the argument may be set out thus: 

5 2n"" > -£'» 5 2n-fl ~ * L. 

Therefore e > 0; 3 N x . \L—s 2n \ < e when n > N x 

and 3 N 2 . \L—s 2rH _ x \ < c when n > A 7 2 . 

Hence 3 N . jL~ s n | < e when n > A 7 , 

and so s n -> L. 


Examples X 


1. Show that each of the series 

1 — i+i — iH-— » 1— i+i— *•* 

is convergent. 

2. Show that l~ p — 2~ p -r-S~ p —... is convergent if p > 0. 

3. Use each of the two methods of Examples VII, 2, to show that, 
when p > 1, 

+ = (i_2 1 -»)(l + 2-» + 3-® + ...). 

4. Show that the series 


-i + 

x-j-\ x -j- 2 ‘ x + 3 

is convergent for all real values of x other than negative integers. 

(If x > —I the series is alternating; if x < — 1 the terms are ultimately 
alternating in sign; in the latter case use Theorem 13.) 

5. Prove that the series 

x 2 x z 

x ~~ Y T T ” *" 

converges if — I < x < 1. (If — 1 < x < 0, we have a series of negative 
terms; use Chapter V.) 

6. Prove that 

V (— I ) n + 1 = 2 Y < zl 1 _)? +1 

n 


co r oo 
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2. Power series 

We have found tests for 2 a n %n when a )t > 0 and x > 0. 
The easiest way of dealing with negative values of x is to use 
the properties of absolute convergence that will be considered 
in Chapter IX. But many examples can be dealt with by 
Theorem 18. We shall work one of the examples of Chapter V, 
Examples VI, and recommend the others as exercises. 

Consider 2 {i n ~r l)j(n-\-2)}x n when x is negative. Let x = ~y. 
The series becomes 

-h+iy-+-+{-^) n ~ ) y n +- • (i) 

If v n = (n + l)j(n + 2), we have 

_w + l n-\-2 I 

W-W+i — ^Tjl2 ri^-3 = "(^+2)(u+3j- 


Hence the sequence (v n ) is monotonic increasing and we cannot 
apply Theorem 18 directly. But we note that r n -> 1. So we 
Write »+l 1 


n+5 


n+2 


and consider the two series 


y— y 2 +y z — - (2) 

and \y— iy 2 +\y 3 — ... . (3) 

By Theorem 18, the series (3) is convergent if 


y n > y” +1 
n + 2 n+ 3 


and 



— > 0 . 


These are both satisfied if y < 1. 

Also (Theorem 5), the series (2) is convergent when y < 1. 
When we subtract the two convergent series (2) and (3) we 
obtain a convergent series; but the series so obtained is (1). 
Hence the se ; es (1) is convergent when 0 < y < 1. 
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L The sequences (a n ), ( b n ) are defined by means of the formulae 
a n -X = a( a n-r & n)’ h n+ 1 = + V^iw-i b n ), 

dj = 0L‘, = jS; and 3 > /?. Show that (a n ) is m.d., (6„) is m.i., and that 

a n , 6 n each tend to the same limit. 

Hint (to be used only after failure). 

If a n > 6 n , then, from (i), a, i+1 > b n , a n+1 < a n ; since a n+1 > b n , 
b n+1 > b n from (ii). Further, 

a n-t-l b “n+l ~ l( a n~^ b u) 2 a n+l b n ~ K a n b 7i) ~ ••• = ^ 

2. In Example 1, if a 1 = cos 6, 0 < 6 < Itt, b x — 1, find expressions 
(by induction) for a n and b n . 

Prove that (a n ) is m.i. and (b n ) is m.d. Show also that a n , b H each tend 
to sin 0/0. 

3. Find expressions for the finite sums 

(i) l 2 + 2 2 .r + ...+ (»+ l) a « tt , 

(ii) i (l+r 2 )/r(r+l)(r + 2)(r+3). 

r - 1 

Discuss the convergence of these sums as n— > 00. 

4. Prove that each of the series 

X n~ 1 (logtt)~ 2 , X w/(n 3 + 1) 

is convergent. 

0. Prove that if a > b > 0 the series 

, , b , 6(6+1) , 

■ a+r(afl)(a + 2) ' - 
converges to the sum a/(a — 6). 

Hint. The series is convergent and its terms are m.d., so that, by 
PringsheinTs theorem, nu n -> 0. Also (compare the start of Example 17) 

a _ 1 , __6 ( 6...(6+n— I) 6...(6+n) 1 

a — b ~ r «+ 1 (a + l)...(a + n) (a + l)...(u + n) a — 6 * 

6. Show that the series 


is convergent. 



?i = 1 


JL_ 

2 yl + 1 



7. Sum to n terms the series whose nth terms are 


1 «(n+l)(w + 2)’ ^ n(n+T)(n+¥j’ 

(iii) «(n+l)(n+2), (iv) m-”" 1 , (v) (n 2 + l)x n . 

Discuss the question of convergence of the corresponding infinite series. 
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8. If the successive terms of a sequence of real numbers ( s n ) are 
connected by the relation s? (+1 = 7s n — 6> and if a is any root of the 
equation x 2 —7x J r 6 — 0, prove that s n — a has the same sign for all 
values of n . 

Prove that 

(i) if s 1 > 2, s n is m.d. and — > 2, 

(ii) if 1 < $! < 2, s n is m.i. and — > 2, 

(hi) if — 3 < s x < 1, s n is m.d. and — > — 3, 

(iv) if s x < —3, a n is m.i. and -> — 3. 

9. Discuss the convergence of 2 sech nx, 2 .r n sec?m^. 

10. Prove that 2 ( — l) n /{^ + 2 + ( — l) n } is convergent. 

11. If u n > 0, s n — zq + ...-f^ n , prove that 2 a ^d ^{uja n ) are 
both convergent or both divergent. 


12. Discuss the convergence of the series 

l+ ih x+ niix*+«)* + ---‘ 


13. If M n = 


1 


show that 


n -j- 1 n 2 -f- ^ 

(i) the sequence u n is monotonic, 

(ii) w 0 — w L -fw 2 — ... — w 2 n-i = 2nu 2n . 

14. Prove that % /(n 2 +l) — n is monotonic and tends to zero. Show 
that 2 (~ l) n W( n2 + 1)— w} is convergent. 

1.3a; 7 


15. Prove that 


x 3 t a: 5 

275 ‘2.4.5" 


2 . 4 . 6. 7 


+ .» 


is convergent when 0 < x < 1 . 
16. Prove that 

2 n(n-j- l)a; n , 




x n 


(n+l)(n+ 2) 

are convergent when 0 < x < 1, divergent when x > 1. 
17. Prove that, if m > n and n is a positive integer, then 


wi-f 1 
m — n + 1 


= nA 


m m(m— 1) 

18. Prove that, when x > 1, 

(i) n/x n and N/x N t where N — 2 n , 

(ii) (®-l)-i-(a:+ 1)” 1 = 2(z 2 -l)- 1 , 
4 


m m— n-p 1 
1 -f — + — “+... to (n+1) terms. 


■ 0 as n • 


00, 


1 ( 2 
(m) i+I + £i+i 


-f 


x iJ r 1 


+.... 


converges to the sum 1 /(j? — 1). 
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19. Prove that the sequence (jl b ), where 

ol h = y(n-r l)—\/y 

is m.d. and -> 0. 

20. Prove that, when 0 < x < 1, 


2 


-1 


n 2 {u^r l ) 2 



n -= 1 u - 1 

21. Prove that, if y is a given positive number less than unity, the 

sequence (aj, where . , . . M , 

ct n = (a — n— l)y n jti, 

is ultimately monotonic decreasing, and that cx n — > 0. 

22. Prove that the series 


, , , a-f 1 „ 

1 -\-ax i 


a-~n— 1 
n 




is convergent when — 1 < x < 1 . Prove, also, that the series is divergent 
when x — 1 and that it is non-convergent when x — — 1 . 



PART II 


THE GENERAL THEORY OF 
INFINITE SERIES 




CHAPTER VIII 

the general convergence principle 

1 . The general convergence principle 

1.1. In Chapter II we gave a formal definition of what is 
meant by the phrase The sequence (a n ) converges to ah In 
Examples II we show r ed that certain definite sequences con- 
verged to certain definite numbers. But this gives no clue as 
to how we are to answer the question 'does the sequence (a n ) 
converge? 5 Chapter II will give the answer to the question 
'does (oc n ) converge to aV only when we know what a is. 

When we came to mono tonic sequences we found a simple 
answer to the question 'does a monotonic sequence converge? 5 
The answer was 'yes, if it is bounded 5 . For example, if'(a n ) is 
mi. and a n ^ 100, then a n -> some limit that is not greater 
than 100. 

If the sequence (a n ) is not monotonic, then the test as to 
whether cx n does or does not tend to a limit, the limit not being 
specified, is contained in Theorem 19. This is a fundamental 
theorem. Whether or not the proof is mastered on a first 
reading is a matter of personal taste, but the theorem itself 
must be. 

Theorem 19. The necessary and sufficient condition that the 
sequence (a n ) should converge (to some finite number a) is 

€ > 0; 3 N . (ay— a v+p | < e for all positive integers p. 

1.2. The condition is necessary. This is relatively simple 
to prove. Suppose that a n oc. Then (see Chap. VI, § 2) 

€, k > 0; 3 N . ja— a rt | < e/k when n ^ N. 

Hence, if p is any positive integer, we have 

kv— “v+pl = Ikv— «)+(«— ot N+p )\ 

< l“ — “A'l+I«— “V+pl 

< 2 e/k. 

Take k = 2 and it follows that 

e > 0; 3 N . jay — ay+p| < e for all positive integers p. 
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This proves that, if a n -> a, then the condition is necessarily 
satisfied. 

1.3. The condition is sufficient. Preliminary. The 
proof of this is more difficult and depends upon the following 
theorem. 

Theorem 20. If the infinite sequence (<x n ) is hounded , it con- 
tains at least one suh-sequence that converges to a finite limit. 
Suppose that 

a < a n < 6 (n= 1,2,3,...), 

and think of the points a, b and the various points a n marked 
off on a straight line. Bisect ab: there is an infinity of points 
a n in ab, and so there is an infinity in one at least of the two 
halves. 

Suppose there is an infinity in the left-hand half only. Put 

a i = a > h= i( a + b )> 

so that a 1 b 1 contains an infinity of the cc n . Bisect there is 
an infinity of the in one at least of the two halves. 

Suppose there is an infinity in the right-hand half. Put 

a 2 = i(«i+&i), h = K 

Continue this process and always make a n b n a part (right- 
hand if possible) containing an infinity of ot n . The construction 
of a n b n from a n _ 1 b n _ 1 is always such that 

> «»-l, b >i < b n-V 


Hence (a n ) is m.i. and, since each a a ^ b, a n -> L 6;. also 

(b n ) is m.d. and, since each b n ^ a, b n — > L x ^ a. 

It follows that r t t 

b n~ a n L x —L. 

But b n —a n = (b—a)2~ n and fends to zero, so that L — L v 
Since a n -> L from the left and b n -> L from the right, 
we have 0 ^ L _ Un < 6 B - a# < (6-a)2- 


0 ^ b n -L < b n —a n < (6-o)2-*. 

(Notice the sign from a certain stage onwards a tl or b n may 
stay fixed at L.) 

Accordingly, if x is any point in a n b tl , then 
\L~~x\ < (b—a)2~ n . 
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Now let a n be the first member of the sequence (a n ) that 
lies in cq&x, a 2 2 0 ^her than <x u that lies in ct 2 b 2 , a 33 

the first other than a n and a 22 that lies in a 2 b z ; and so on. 

We then have a sequence (a partial or sub -sequence of the oc n ) 

a llJ a 22> a 33v 

such that \L—a nn \ < (b—a) 2~ n . 

Hence, on writing p n == oc nn , p n -> L as n -> oo . 

Notice that, by its mode of construction, L must he either 
inside ab or, in extreme cases, at one or other of a and 6; it 
cannot lie outside ab. 

1.4. Corollary. If the infinite sequence (a n ) is bounded , 
then either it converges or it contains two sub-sequences that con- 
verge to different limits. 

As in the theorem, there is one sub-sequence (fi n ) that con- 
verges to L. Then 

either (i) for each and every € > 0, only a finite number 
(or none) of the <x n are such that \L—cc n \ ^ e, 

or (ii) for some e > 0, an infinity of oc n are such that 
\L—at n \ > e. 

If (i) holds, then a n -> L (by definition of convergence). 

If (ii) holds, let A be a definite positive number such that 

| L—a n \ ^ A for an infinity of cc n . 

Let (y n ) be the sequence we get by omitting from (a n ) all the 
terms such that \L—oc n \ < A. Then, if L is neither a nor b (if it 
is, slight changes are necessary: these we leave to the reader), 
the sequence (y n ) lies in a, L—X and L+X,b. Moreover, by 
hypothesis, (y n ) is an infinite sequence. 

Either in a , L—X or in L- f A, b there is an infinity of y n . We 
can, as in the theorem, select a sub-sequence which converges 
to some number L v and, as L x cannot be within L—X , L- f A, 
L i cannot be the same as L. 

That is, (oc n ) contains two sub-sequences, one of which con- 
verges to L and the other to L ± ^ L. 
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1.5. The condition in Theorem 19 is sufficient. Suppose 
the condition is satisfied; that is, 

e > 0; 3 N . | a y — a x+p I < € for positive integers p. 
Then, when m > some definite M (the value of N when e = 1), 

< l > 

i.e. Ojf— 1 < 

The sequence a J/+1 , a 1/+2s ... is bounded. Hence (Corollary, 
Theorem 20) it must either converge or contain two sub- 
sequences that converge to two distinct limits L and L x . Rut 
the latter is impossible when our condition is satisfied. For, if 
possible, suppose there are two such sub-sequences and that 
L x > L. Then, if h is a given positive number, 

3 N . I'Xy—av+pl < — y— for all positive integers p. 

1C 

Since one sub-sequence -> L and the other -> L l9 there are 
positive numbers q, r such that 

it \ ^ -^1 | r \ -^1 

\ L ~' “v+ffl < 1^1“ a .V+rl < ]T~- 

It follows that 

\L 1 —L\ = |(£i— a.v+r)+(<*v+r— “v)+(«v- «V4«)+(%+ S - i)l 
< 1-^1— “V+rl+ i“v+r— “vl+ |a.v— av+ s l+ l“v+ a — 

That is to say, if there were two sub-sequences converging to 
distinct limits, it wnuld follow, on taking h = 4, that 

L x — L < L ± — L , 

which is absurd. Hence the sequence (a n ) must converge. 

This completes the proof of Theorem 19. 

1.6. Complex numbers. Complex numbers will be con- 
sidered in a later chapter. In all other contexts numbers are 
supposed to be real unless the contrary is stated. 



CHAPTER IX 

absolute and non-absolute convergence 

1. The convergence principle applied to series 
The infinite series u l +u 2i +... 

is convergent if the sequence (s n ), where 

is convergent. 

Theorem 21. The necessary and sufficient condition for the 
series 2 u n to be convergent is 

€ > 0; 3 N . \u N + 1 +...+u y+p \ < 6 
for all positive integers p. 

This is an immediate corollary of Theorem 19, for 

S N+p~~ S N == U N+l J T‘- J r u N+p- 

2. Absolute convergence 

2.1. DEEmmoisr. The series 2 u n is sa >id to be absolutely 
convergent if the series 2 \u n \ is convergent . 

Theorem 22. If a series is absolutely convergent , then it is 
also convergent . If a series is convergent it is not necessarily 
absolutely convergent . 

Suppose 2 \ u n\ convergent. Then 

e > 0; 3 N . ||^iv+il + -«* + Niv+pil < € 
for all positive integers p . But (modulus of sum < sum of 
moduli) \u N+1 +...~\-u N+P \ < |^v +1 | + ...+ |%r +p |, 

and so e > 0; 3 N . Kv+i+-«+^v+pl < e 

for all positive integers p . Hence, by Theorem 21, 2 u n 

convergent. 

On the other hand, particular examples show that 2 may 
be convergent and 2 \ u n\ divergent: e.g. 1 — ... is con- 

vergent, l + |--f-|+... is divergent. (Cf. Theorems 18, 7.) 

2.2. Theorem 23. (i) If a series is absolutely convergent , then 
the series formed by its positive terms alone is convergent , and 
the series formed by its negative terms alone is convergent . 
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(ii) If a series converges but is not absolutely convergent , then 
the series formed by its positive {negative) terms alone is divergent . 
Let the series be a ni and let \a n \ = Further, let 
t when is positive 

~ — |q when a n is negative, 

__ __ fa n when a n is negative 

Qn — 2 \ a n a 7i) — |q when a n is positive, 

= jPl+ — +JP* i> = £l+ — +£n> 

*» = + ^ <*n = “l+- + <V 

With this notation we have, by easy algebra, 

P a = + = £(*n“ *»)• (*) 

But if ^ a n converges absolutely, then cr n -> a finite limit, cr say, 
and s n a finite limit, 5 say. Hence 

Pa~> %(* + *), + m 

and (i) follows, since P n , Q n are formed respectively from the 
positive, negative terms alone. 

To prove (ii) suppose that the series formed by the positive 
terms alone is convergent and that the original series is con- 
vergent. Then P n -> a finite limit, P say, and s n -> a finite limit, 
8 say. It follows, from (1), that 

c ^ 2P—s , 

i.e. the series of absolute values, 2 a n> is convergent. 

Hence, if a n is convergent and * n is divergent, the series 
of positive terms alone cannot converge. 

2.3. The ratio tests. When, in Chapter V, Examples VI, 
we considered power series such as 

1 + 2 *+3z 2 +..., (1) 

we confined our attention to positive values of x. We now see 
that this series will converge, whether x is positive or negative, 
provided that i + 2 \ x \ + 3 \x\*+... 

is convergent. If we write u n = (n+\)\x\ n , 

«» _ (^+1) , 1 
u n+i (n+2)\x\ lasj * 

Hence the series (1) is absolutely convergent when \x\ < 1. 
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The examples that follow deal with the same series as did 
Examples VI, but negative values of x are now included. 


Examples XI 

1. Prove that each of the series 

converges when \x\ < 1 , diverges when x — 1 , and does not converge 
when \x\ > 1. Show that the third series is the only one of the three 
that converges when x = — I. 

Hint. When |rc| < 1, consider the series of absolute values and use 
the ratio tests. When \x\ > 1, the nth term u n does not tend to zero, 
and Theorem 14 proves the result. When x = — 1, only the terms of 
the last series tend to zero and the convergence of this series is proved 
by Theorem 18. 

2. Prove that the series 

1 + —,X + y + - 1 - gg+ «*+... (C,d> 0) 

c.d c(c-fl)d(d-f 1) v ' 

converges when \x\ < 1. 

3. Prove that each of the series 

/*v*2 /y>3 

l+*+7r, + ?r.+-, 


, , o.6 

1+ Zd x - 


a +... (o,d> 0) 


x 4 x b 

*+ 3 l + Tl +... 

converges for all real values of x . 

4. Show that '£n\x n cannot converge for any real value of x . 

Hint. is ultimately greater than \u n \ 9 and so u n cannot tend 

to zero. 

5. Show that X nkxU converges when k is any fixed number and 
\x\ < 1. Show that it does not converge when \x\ > 1 and find for 
what ranges of values of k it will converge when x = 1, when x ~ —1. 

6. Show that each of the series 

, , , *+l , o + 2 , , 


1 | ffl j. | 

1+ 2* + 2.4* 


;S 3 +—. 


o 2(a+l) 3(o+2) 

1+ 2 + 2.4 + 2.4.6 


is convergent for all real values of x. 

7. Show that the series 






converges when \x\ < |6|. 
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3. Abel’s and Dirichlet’s tests 

3.1. Let (a n ), (v n ) be any two sequences, and let 

* n = a 1 +a 2 -r...+a n . 

Then, by simple algebra, 

a i v i~r a 2 v i J r-- J r a n v n (1 ) 

= s i *1+ ( 5 2 • • • + ( S n ~ S n-l) V n 

== s l( l 'l ^2 ) “t~ ( ^2 ^3)^” (") 

That is, we have transformed (1) into another shape, namely (2), 
wherein we e sum the a s and difference the rV. 

Now suppose that 

(i) (v n ) is a m.d. sequence of positive terms, 

(ii) the numbers h, H are such that 

h < s r < H (r = 1, 2 

Then we havet 

< S i (v 1 —l' 2 )+8 2 (V2 — ^ 3 ) + *“+ 5 7 i- 1 ( t A- 1 ~ + ^ 
that is, by the equality of (1) and (2), 

hl\ ^ + 

Similarly, a 1 v 1 +a 2 i> 2 + *"+ a n v n ^ & v v 

3.2. We now collect these results into an important lemma. 
Abel’s lemma. If ( v n ) is a monotonic decreasing sequence of 

positive numbers , and h , H are such that 

h ^ a 1 +a 2 +...+u r ^ H (r = 1, 2,..., n), 
then hv ± < a 1 v l +a 2 v 2 + ...+a n v n < Ifrq. 

In this lemma h or H, or both, may be negative. The 
notation a < b means that a is algebraically less than b; thus 
— 3 < —2. When we use absolute values we need the following 
result. 

Corollary of Abel’s lemma. If (v n ) is a monoionic decreas- 
ing sequence of positive numbers, and K is such that 
\ a i~f a 2 J r •- J r (X r I ^ % ( r = I? 2,..., n), 
then Wi^i+^ 2 v 2 +- + a n v n\ < 

I Notice that the argument depends on v n > v n+1 . If, for example, v 3 < v 3f 
then v 2 —v 3 is negative, and so 

(v 2 —v 3 )h > s 2 (v 2 ~r s ) when h < s 2 . 
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This follows almost at once from the lemma itself. For w^e 
can write the condition |^ 1 +« 2 +---+ a rl ^ K as 
— K ^ + ^ 

and so, by the lemma, 

—Kv 1 < a 1 i’ 1 +a 2 v 2 +...+a n ^ < Kv v 

3.3. Theorem 24. // (a n ) is a sequence of numbers such that, 
for some fixed number K } 

l a i+ a 2 +*“+&nl < K for all n, 
and ( v n ) is a monotonic sequence that converges to zero , then 
^ a n v n is convergent . 

Suppose, in the first place, that (v H ) is a monotonic decreasing 
sequence of positive numbers, and that v n -> 0. Then 

£, Jc > 0; 3 N . 0 < v n < Jce when n ^ N. 

[It is a matter of indifference wdiether we use e times Jc or e 
divided by Jc.] 

But, for all positive integers p , 

I a X+l + a N + 2 + • • * + I 

= \( a i J r a 2 J r >" J r a N+p)~( a i J r a 2 J r •••+®v)[ 

^ |^i+«2+-“4- tt .v+pl + |Ui+u 2 +--*+ a vl 

< 2 K. 

Hence, by the corollary of i^bel’s lemma, 

l a v+i%+i+---+^ C+p ®N+p | < 2 Kv N+l 

< 2KJce. 

On putting Jc — 1 /2 K, we see that 

€ > 0; 3 N . Ja iV+1 % +1 +...+^jv+p%+pi < € 
for all positive integers £>. Hence, by Theorem 21, ^a n v n is 
convergent. 

If ( v n ) is a monotonic increasing sequence (of negative terms) 
that converges to zero, (— v n ) is a monotonic decreasing sequence 
(of positive terms) that converges to zero. As we have proved, 
2 — a n v n is convergent: hence 2 a n v n * s convergent. 

Definition. A series 2 a n sa ^ io bounded if there is 
a constant K such that \a 1 J r a 2 J r ...-\-a ri \ < K for all n. 
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A convergent series is necessarily bounded (by Theorem 1), 
though not all bounded series are convergent: for example, the 
sum of any number of terms of the series 
1-1 + 1-1 + ... 

cannot exceed unity. 

3.4. Theorem 25. If is a convergent series and (rj is 
a monotonic sequence that tends to a finite limit , then ^ v n is 
also convergent. 

The theorem has no interest if 2 a n i s absolutely convergent, for (v n ) 
is bounded, by hypothesis, and so 

\a n v n \ < K\a n \, 

say. If 2 \ a n\ is convergent, the convergence of 2 \ a n v n\ follows from 
the comparison test (Theorem 8). 

If 2 a n is convergent but not absolutely convergent, then the positive, 
negative terms alone form two divergent series. The convergence of 
2 ct n is due, so to speak, to the nicety of balance between a diverging 
positive and a diverging negative. The theorem asserts that this nicety 
of balance between the positives and negatives is not upset by the 
introduction of the factors v n . 

Suppose that v n -> v, and that 

s n — a i J r a 2 J r -• J r a ’n 

Let u\ = v—v n . Then 

<tiVi+a 2 v % +...+a n v n = s n v-{a 1 w 1 +a 2 w 2 +...+a tl w n ). 

Let a n = a 1 w 1 +a 2 Wi+...+a n w n . 

The sequence (s n ) is bounded, since s n -> 5 (Theorem 1). Hence 
there is a number K such that 

l a i+ a, 2 +---+ a J ^ -H- ft)r all n. 

Further, the sequence (w n ) is monotonic and converges to zero. 

Hence, by Theorem 24, the series 2 a n w n is convergent; 

that is, n v ., 

a n -» a nmte limit, a say. 

Accordingly, 

a i^l + a 2 V 2 +'-~T a n V n = S n V ~ u n 

*-> sv — a. 

Hence the series 2 <* n v n is convergent. 

3 . 5 . Theorem 24 is usually called Dirichlet’s test, and 
Theorem 25 Abel’s test. Before we give special examples we 
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note one result, an example on Theorem 24, which is of almost 
sufficient importance to rank as a theorem. 

Lei (: v n ) be any monotonic sequence that converges to zero. Then 
2 v n sinnQ is convergent for all real values of 9, and 2 v n cos nd 
is convergent for all real values of 9 other than zero and multiples 
of2ir. 

By elementary trigonometry, when 8 is real and sin \6 ^ 0, 


n 

2 cos rd 


sin nd cos 1 )d 

1 

-*-*• 


sin \8 

|sin £0| ’ 

I 71 1 

2 sin rd 


i sin \nd sini(?t+l)0 

^ 1 


sin \d 

|sin \d\' 


Hence, if sin \d =£ 0, we may put K = | cosec \Q\ in Theorem 24 
both when a n = cos n6 and when a n = sin nd. But sin =£ 0 
unless 9 is zero or a multiple of 2tt. Hence 

2 v n sinnd, 2 v n cos nd 

are convergent unless 6 is zero or a multiple of 2tt. 

When 9 is zero or a multiple of 2 rr, the first series is merely 
a series of zeros, while the second is 2 v n an d may or may not 
be convergent. 


Examples XII 


1. Prove that, of the series 

2 cos nd W sin nd 

n 9 2 L 4 n 


cos nd 


2 sin nd 
~~n^’ 


all save the first converge for all real values of 6 . 

2. Prove that 2 n ~ h cos n d is convergent for all real values of 6 if 
h > 1, and is convergent for all real values of d other than multiples of 
2t t (including zero) if 0 < k < 1. 

3. If 2 a n converges, then 2 a n n ~ x converges when x > 0. 

4. If # is not a positive integer, then 


2 fir, V an 

n 9 2 n—x 


are both convergent or both non-convergent. 

Solution. If 2 ajn converges, write v n — nj(n—x), Then 

x 


Vn Vmt-l — 


(n-x)(n-}-l—x ) 9 
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and, when n > [s], this has the sign of x. Hence the sequence (v n ) is 
ultimately monotonic; also, 1 as n-> oc. Hence, by Theorem 25, 



is convergent. 

The same method applies if we suppose the second series to be con- 
vergent: we then prove that the convergence of the first series follows. 

5. The series 2 ( — l) n ” 3 (n— a:) -1 is convergent when x is not an 
integer. 

6. The series 2 ( — l) w /V?i, 2 (— l) n l^!(x-rn) when x is not a negative 
integer, are both convergent. 

7. The series 2 ( — 1 ) n b n is convergent provided that b n tends mono* 
tonically to zero. (Put a n = ( — l) n in Theorem 24.) 


8. Prove that * 

Z* n-f-£ 


convergent for all real values of x. 


3.6. The more general forms of Theorems 24 and 25. 
The two theorems 24a, 25a that follow are more general than 
the previous ones and are also applicable when a n9 v n are 
complex numbers, but it is not so easy to see whether they 
apply to any particular series. The new theorems are all but 
self-evident if w r e return to the identity of § 3.1 and remember 
that ^ a n converges if \a n \ does. 

In § 3.1 we proved that 

v n (1) 

= 5 i(V -^)+s 2 {v i -v i )+...+s n _ 1 {v n _ 1 -v n )+s n v n , (2) 
where s n = a l +a i +...+a n . 

Let 2 \v n — v n+1 \ be convergent and let y a n be bounded, i.e. 

3 K . [sj < K for all n. 

Then *»+i)l < K\v n -v n+1 \, 

and each of the series 

2 ^iSPn ^n+l)> 2(^71 V 7i+l) (3) 

is convergent. Since ^ s n( v n~~ v n+i) is convergent, 

le * i a l v l +-+anVn)~S n V ns 

tends to a finite limit. 


(4) 
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Since 2 ( v n,~ v n+ 1) is convergent, 

i.e. v x —v n , 

also tends to a finite limit; that is, v n -> v, a finite limit. 

It follows from (4) that, if 

either v n ->Q 

or s n -» s, a finite limit, 

then {d 1 v 1 +...+a n v n ) tends to a finite limit; for in the first case 
Kl < & an< 3- s a v a and in the second case v n -» We 
now enunciate the theorems that embody these results. 

Theorem 24 a. If 2 ct n is bounded , 2 l^n — ^n+il is convergent , 
awf -> 0, then 2 ^ is convergent . 

Theorem 25 a. If ^a n is convergent , ami 2 |v n — t? n+i | is 
convergent , then 2 a*, ^ is aZso convergent. 

3.7. Worked example. If (-y n ) is m.d. and 2 is convergent, then 
2 n(r n — v w+1 ) is convergent and its sum is 2 
To deal with problems of this type, use §3.1 with a n = 1, so that 
s n = n. Thus, 

v x +... + v n = (Vi—v 2 )+2(v 2 — v B )+ ... + (n— l)(v n „ t —v n )+nv n . 

In the first place, v n -> 0 since 2 v n is convergent and so, in the second 
place, v n must be positive since (v n ) is m.d. Finally, by Pringsheim’s 
theorem (Examples VIII, 12) nv n -> 0, and the result follows. 
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we "can deduce the second from the first but not the first from 
the second. So, in considering series, of the two statements 
u 1 +u 2 J r ... is convergent and its sum is s , 

(%+•" + u » l ) + (^n 1 +l+* "+ w n,)+ — 

is convergent and its sum is s , 

we can deduce the second from the first but not the first from 
the second. 

Briefly, we may put brackets in and be sure of our results, 
but if we take brackets out we must subject our work to 
careful examination. 


Examples XIII 


1. The series 
has a general term 


_1 1_ 1 

2n 


2n—\ 2n 2n(2n— 1) 
and is convergent (the terms are comparable with those of X ^~ 2 )* 
It does not at once follow that 

1— J— i+ — 

is convergent: all we know from the previous work is that 

* 2 » = l-2 + 3-4 + --2^ a - 
But we can easily complete our work: for 

and — > 0 as n -> oo. 


1 


*2n+l" 


■ 0 + 5 = s ; hence s n —> s 


2 yi -\- I 

But s 2n -> 5, and so s 2n+1 — (s 2n+1 — s 2n )+s 2n - 
whether n be odd or even. 

2. Theseries (2— f)+(f — f) + ... 

is the same as the series in Example 1. But if we remove the brackets. 


we now get 
We see that 


2— f +f — f + — 

, _ 2 _»+*_* + _ 2n + 1 
8 Zn — * ^ 


5 2n+-l : 


2 1 3 

3 4 5 

2 — - -L. _ — — a. 4 .: 

2 ‘ 3 4^”’^2n+l 

1+1 “I + §~i + - + 2^TT 


2n 

' 2n' 
2n+ 2 


8 zn+l~~ s zn ~ ^ 1* 

The series without brackets is not convergent. 
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3. Prove that 

i-f(2—l-)+(t— !)+... = 2— (}—$)— (S-!)—.... 

4. Prove that 


+ = 1 — — — — 


2. Change of order of the terms of a series 
2.1 . In a finite number of terms, say 

(4) 

the algebraic sum is unaltered by writing the terms in a 
different order. 

In an infinite series we must first say what we mean by 
'writing the terms in a different order 5 . 

Definition. The series 


6^ “f* &2 “T ^3 ~f" ♦ • • 
is the series %+^ 2 + a 3 +-*- 

with its terms in a different order if every b r comes somewhere 
in the a series and every a r comes somewhere in the b series; 
2 b n is also said to be a rearrangement of 2 ct n . 


Examples. (i) l-Rf-J-H-H-..., 
and — £+1— 1+1— 

(ii) 1— 1+J— 1+1— 1+..., (5) 

and 1+1-J+H-H1+-- 


The second example brings out a point that marks an important 
difference between finite and infinite series, namely, we can 
go on for as long as we like putting two positive terms to one 
negative term. If we were dealing with a finite number of terms, 
say 20 terms, some of which were positive and some negative, 
and began by putting two positive to one negative, we should 
be obliged to stop when we had exhausted all of one sign and 
fill in with those terms we had so far left out. For example 
terms 

may be rearranged as 


_j j i i i 

12 14 16 18 20 * 


1 + 1~ |+5+7~i+ •••+17+15—15—1 

Here we have gone on as long as possible putting two positives 
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to one negative, but at the end we have been obliged to redress 
the balance by putting in all the negatives we had previously left 
out. 

But, as we have seen, w T hen rearranging the infinite series (5) 
we can continue ad infinitum with two positives to one negative. 
We cannot expect that the sum of the series will remain the 
same as it was before. 

2.2. Suppose that «i+« 2 + — 
is a given series and that 

^1+^2+ — 

is a rearrangement of it. The sum <?f the first series is the limit, 
if it exist, of a sequence 

*l, s 2 ,..., wher e« tt 5fl 1 +..,+a B ; 

the sum of the second series is the limit, if it exist, of a sequence 
G V cr 2 ,..., cr n ,..., where a n = &!+... +6 n . 

The two sequences may well be quite dissimilar and it is, 
on the face of it, as likely as not that their limits will be 
different. 

There is one important general theorem that deals with 
rearrangements of infinite series, namely, 

Theorem 26 . If a series is absolutely convergent , then its sum 
is unaffected by any change in the order of its terms , 

2.3. Proof of Theorem 26 for a series of positive terms. 
We first prove the theorem for a series of positive terms. Let 
each u n be positive, and let 

v 2 J r • • • + * • • 

be a rearrangement of the series 

u 1 +u 2 +...+u n +.... 

As yet, we make no assumption that either series is convergent. 
Let = u ± +...+u ni a n = v 1 +„.+v n . 

For any definite value of n, s n contains n terms each of which 
comes, sooner or later, in the v series, and so we can find a 
corresponding m such that a m contains all the terms of s n (and 
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possibly others not contained in s n ). Since each term is positive, 
@ m > s n . Hence 

given n, 3 a corresponding m . a m > s n . 

Suppose now that the v series is convergent. Then the 
sequence (<r n ) has a finite upper bound a, say. Since a m > s ni 


G ^ 


> , 


Hence the upper bound (cf. the definition of Chap. Ill, §1.2) 
of the sequence (s n ), say s } cannot exceed a: hence the u series 
is convergent and a > s (6) 

But, for any definite value of n } a n contains n terms each of 
which comes, sooner or later, in the u series, and so we can find 
a corresponding M such that s M contains all the terms of a n (and 
possibly others not contained in a n ). Since each term is positive, 


S M ^ °Vi* 

Since s ^ s M) it follows that s ^ a n , and so a, the upper bound 
of the cr n , cannot exceed s : hence 


a > a. (7) 

By (6) and (7), s = cr, 

and the u series has the same sum as the v series. 

Suppose now that the v series is divergent. Then u n increases 
indefinitely and, since we can find an s 3jf to exceed any given 
o ni s n must also increase indefinitely and hence the u series is 
also divergent. 

Alternative treatment of divergence. Suppose the v series is 
divergent. Then 

A > 0 ; 3 N . cr n > A when n > N. 

But, as we have seen, M . s M ^ a N and hence 
3 M . s m > A when m > M. 

Hence the u series is also divergent. 

2.4. Proof of Theorem 26 for absolutely convergent 
series. Let 2 a n an absolutely convergent series; let P be 
the sum of its positive terms alone, Q the sum of its negative 
terms alone. Then (Theorem 23) if s is the sum of 2 
s — P+Q (Q is, of course, negative). 
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Any change in the order of the terms of 2 a n gives a new 
series which, by § 2.3, is such that 

its positive terms alone converge to P, 
its negative terms alone converge to Q. 

Hence (Theorem 23) the new series is absolutely convergent 
and its sum is P+ Q , so that the new' series has the same sum 
as the old one. 

Example. The two series 

1,1 1 , 1 . 1 111 1 

1 2 ^ 3 2 42 + - +32 2 2 + 5 2 + 7 2 4 2 +’“ 

are absolutely convergent and have the same sum. This should 
be contrasted with the example given in § 2.5. 

2.5. Further results about rearrangements of series. 
If we rearrange the order of the terms of a non-absolutely con- 
vergent series 2 a n> we ma y or ma y not change the sum of the 
series. Roughly speaking, the sum will be changed if we 
interfere too much with the balance between positive and 
negative terms. 

In the following example the new series gives more weight to 
the positive terms than the original series does. 

Example. The series 

1— i+J— (8) 

i+H+i+hi+... (9) 

are convergent and their sums are log 2 , flog 2 respectively. 

For the purpose of working this example we assume the 
result, which will be proved in Chapter XIV, that as n -» 00 , 
, 1 , 1 , ,1 , 

where y is a constant (Euler’s constant). 

Assuming this result, we see that w'e may write 

11 1 

l + 9 + g + *** + ~ = log ?i+y n , 

where y n y as n 00 . (This procedure reduces the difficulty 
of handling limit problems connected with 1 +£+§+... .) 

The series ( 8 ) is an alternating series whose terms tend 
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steadily to zero and so (Theorem IS) the series is convergent. 
Let s n denote the algebraic sum of its first n terms; s the sum 
of the series. Then 


s = liras, t = lims 2)l = lim (l — ^ + ... — Tj 

n — *X 71— >00 71— >00 \ +*flj 


-i"[( i+ ^3 i+ -+s)- 2 

"Sl[( 1+ i + i + '" + s) _ ( 

= lim (log 2ft+y 3)l — log n — y n ) 

n->x 

= lim (log 2 ~y 2n —y n ) 


■ 1 ■ , 1 
- 5T7 T-TZ 


l+4+...+i 


= log 2, 

since y in -y n -> y— y = 0. 

The series (9) is not obviously convergent by any of the 
standard tests. We begin by considering the sum of 3 n terms 
(equivalent to first considering the series where the terms are 
bracketed in groups of three). Let a n denote the sum of the 
first n terms of (9). Then 




4?i — 3 ' 4?i — 1 2 n 


= log4ra+y 4re — i(log2»+y 2n )— l(logw+y„) 

= flog2+(l-i-J)log»+y to _J ysi| _Jy B ^ flog 2. 

Further 


°3?t+l ~ a 3/i + 


4-n-h 1 


5 lo § 2 ’ 


a 3n+2 — a Ztt ' 


4ft + 1 ‘ 4?i + 3 


3, « 

^2 l0g: 
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Hence, not only the bracketed series 
but also the series, without brackets, 

is convergent and has the sum flog 2. 

3. The multiplication of two infinite series 

3.1. Suppose, for a moment, that we disregard all questions 
of convergence and see what form of answer we should get if 
we were to multiply together 

a 1 +a 2 x+a 3 x 2 +...+a n x n - 1 +... 
and b 1 -\~b 2 x-{-b z x 2 -\-... J r b n rr u “ 1 +... . 

The form of answer is, clearly, 

a l bi J T i a l &2“i~ a 2 ^l) rc +--- + ( cl l^7t + a 2 + bjjx 71 ” 1 +... . 

We state our theorems about the multiplication of series 
in such a form that they can be used easily for power series. 
The coefficient of x 71 - 1 in the previous work gives the reason 
for our choice of c n in the subsequent work. 

3.2. Theorem 27. If 2 a n > 2 b n converge absolutely, and 

c n ~ a ?i^l+ a n-1^2+*** + a l^nJ 

then 2 c n i s absolutely convergent and ^c n = (^a n ) 6 n ). 

Let 

A n = %+%+---+^ n5 A’ n — |®il+ I&2I + ---+ 

B n — b x +b 2 +^- + b n , B' n = |&i|+|& 2 l + --+l&nl> 

and let A n ->A,B n -+ B, A 7 [ A\ B’ n -> B'. 

Write down the terms of the product A n B n thus: 


a iK 

«i& 2 

a ±b 3 

• • a iK 


b 2 

a 2 b z 

a 2 b n 

a-sh 

a 3 b 2 

a 3 6 3 

■ ■ a 3 b n 

a n b t 

a n b 2 

a n b 3 . 

• • a n b n‘ 


(S) 
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Consider A n B n set out in the form 
A x B 1 +(A 2 B i -A 1 B 1 )+ 

~r (A z B z —A 2 -B 2 )-f ...+(A B n —A n _ 1 B n _ 1 ) J 
that is, a 1 b 1 +(a 2 b 1 -j~a 2 bo-l~a 1 bo)-r.'. to n terms. (1) 

Now remove the brackets from (I) and consider the infinite 

series a l b l -\-a 2 b 1 - r a 2 ^ 2 d" a i^ 2 "r a 3 ^id~ a 3 ^ 2 d~--- • (2) 

First step. The sum of the moduli of any number, say m } of 
its terms < some A* n B’ n \ for we can choose n big enough to 
ensure that all the m terms are in the square (S) and the sum 
of the moduli of all the terms in (S) is A’ n B’ n . 

But A f n is a mi. sequence and so A' n < A' and, similarly, 
B f n < B*. Hence A' n B' n < A'B'. Hence (Theorem 6) the series 
formed by taking the absolute values of the terms in (2) is 
convergent; that is, (2) is absolutely convergent. 

Second step. The sum of the series (2), which has no brackets, 
is equal to the sum of the series, with brackets, 

a i^l+( C 2^1+ a 2^2+ a i^2) + -** + ( a ?i^l+ Cf n 

= lim A n B n , 

n-+ oo 

as w T e see by looking at (1), which is another way of writing 
A n B n . But A n -> A } B n -> B. Hence (2) has the sum AB. 

Third step. Since (2) is absolutely convergent, any series 
got from it by rearranging its terms is also absolutely convergent 
and has the same sum. Hence 

a i^iA’ a 2^i J r a i^2 J r a z^i~\~ a 2 b2-{- a i^z-v a ^b 1 J r ... (3) 

is absolutely convergent and has the sum AB. 

Finally, the series got by putting brackets in (3), namely, 

a A+( a 2^1 + a i^2) + *-* + ( a /i^l + a n--l^2+*-* + a i^) + --- > (4) 
i.e. 6 1 +c 2 4-...+c /l +..., 

is absolutely convergent and has the sum AB. 

Examples XIV 

Questions 1-6 may bo made to depend on the fact that 
Hof o+»d log ?i y as n -> oo. 

M O 71 * 

1 . 1 + 1 + g + - + ~\ lo s n -*\y+ lo s 2 - 
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, 1 1 , 1 , 1 I , , 1 

2 * 1+ 2”3' r 4 + 5^6 + ‘** + 3^ 


.^-Ijogn^ly+logS. 


3. 1 — -J-f i“~ ! + •** is convergent: its sum 13 log 2. 


4 - 2^bi-)=- 2+31 ° g2 - 

n- 1 

5. The series obtained by rearranging the series 

1 — i+J — i-r*.. 

so that 3 positives alternate with 2 negatives, that is, 
has the sum £ log 6. 

6. If, in Example 5, p positives alternate with q negatives, the suiq 
is log2 + Jlog(p/g). 

7. If 


A(x) — a 0 J r a l z J r a 2 x 2j r ..., B(x) = 6 0 *f b l x+b 2 x*+..., 
each series being absolutely convergent, and if 

c n = a n 6 0 +a J1 _ 1 & 1 + ...-f a 0 h n9 
then A(x)B(x) = c 0 + c 1 a: + c 2 ^ 2 + ... . 

8. If a 0 4-a 1 rr-f...-|~a rt a; n -J-'-** is absolutely convergent when |j?] < 1, 
and if A (x) is its sum, prove that, when \x\ < 1, 

(1— x^Aix) = 2 s n xTl > 

n-Q 

where s n — a 0 *f 0i-K*.+a»* 

(n+rV 

9. Prove that, if A r n == - — — and A \ ; s 1, then 

n\r\ 


2 Al = A™. 

v — 0 


Hint. One method is to write 


n f 

2 a; = A r n \ 

v=0 ' 




n{n— 1) 


n-\-r (n+r)(n+r— - 1) 


and to use (cf. Misc. Exx. on Chaps. I- VII) the fact that 

nJr l"t} — iji n __ n- fr— 1 | 

r-fl ~ ~n-{-r‘r-f 1 ~ ‘.n-f-rl 1* r-f 1 j‘ e c * 

10. Prove, by induction (using Example 9), that when |a?| < 1 

(l-z)-’*- 1 = £ Alx\ 

n = 0 

11. By writing (l -~x)~ r ~ 8 '- 2 — (1— x)- T ~\l — a?)-*- 1 , prove that 


2 
v = 0 
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12. Prove that the series 

/y»2 /y»3 

1 +X +21 + 3]+- 

is absolutely convergent for all real values of x. If E(x) denotes its 
sum, prove that E{x)E{y) — E{x+y). (Prove the result by means of 
Theorem 27, not by quoting e x .e y — e x+v .) 

4. Abel’s continuity theorem-}* 

4.1. Before we obtain the next theorem about the multi- 
plication of in fini te series w T e establish two preliminary theorems 
about power series, a topic we shall not discuss systematically 
until later. 

Theorem 28. If ]T a n is convergent [not necessarily absolutely 
convergent), then ^a n x n is absolutely convergent when \x\ < 1. 

Since ^ a n is convergent, a n -> 0. Hence 

3 N . \a n \ < \ when n ^ N. 

When \x\ < 1, 2 \ x \ n is convergent. By the comparison test, 

i k*“i 

A r 

is therefore convergent when \x\ < 1. Hence (Theorem 13) 

CO 

2 a n % n is absolutely convergent when \x\ < 1. 

n== 0 

4.2. In the enunciation of our next theorem we employ the 
idea of a function of x tending to a definite limit as x tends to 
a definite value. The formal definitions are 

Definition. Dorm B. A function f(x) is said to tend to the 
limit l as x tends to a certain value a from values less than a if, 
having chosen any positive number € whatsoever , we can then find 
an X such that 

\f{x)—l\ < e when X < x < a. 

We mite f(x) -> l as x-> a— 0. 

Notice that we are completely uninterested in what the value 
of f(a) may be: we want the behaviour of f(x) for values of x 
a little less than a . 

t Some readers will prefer to omit all save the result of Theorem 30 on a 
first reading. 



THE PRODUCT OF TWO SERIES 


79 


Definition. Form C. A function f(x) is said to tend to the 
limit l as x tends to a certain value a from values less than a , if 
€ > 0; 3 X . \f(x)—l\ < e when X < x < a. 

We shall use, without the formality of a separate proof, 
theorems analogous to those given in Chapter VI, §1.1. 

There is a similar definition dealing with values of x greater 
than a. 

Demhitiox. f(x) ->l as x -> a from values greater than a if 
e > 0; 3 X . \f(x)—l\ < £ when X > x > a. 

We write f(x) -> l as x-> a-\- 0. 

Finally , if f(x) -* l both as x-> a— 0 and as x-> a+0, then 
we say that f{x) -> l as x -> a. 

CO 

Theorem 29. f If ^a n is convergent and s is its sum , and if 

n = 0 

00 

/(x) denotes the sum of 2 & ?l x n when \x\ < 1 (c/. Theorem 28), 

71=0 

then f(x) -> s as x 1 /rom values less than 1. 

Let = a Q -\-a 1 J r ...-\-a n . Then, since s n -> 5 , two facts may 
be stated about s n . First, by Theorem 1, 

3 K . \s n \ < K for all 7 1 , 
so that (Theorem 2) |<s| < IT, and 

|s— sj ^ l 5 l+ I 5 tiI < 22ST for all n. (I) 

Next, on using the device introduced in Chapter VI, § 2, 

£, h > 0; 3 N . |s— sj < e& when w > N. (2) 

We now consider 

1— x 

When \x\ < 1, we have 

/(«) = a Q +a 1 x+a 2 x 2 + ...+a n x n + ... , 

(1— x) _1 = l+#+£ 2 +-..+£ 7? '+-“> 
the two series being absolutely convergent. Hence, by Theorem 
27, we may multiply them, collecting like powers of x, and so 
obtain 

(1 — x)~ 1 f(x) = a Q 3-(ao^af)x^(a 0 -l r a 1 -}-a2)x 2j r-'- 
= s Q +s 1 x+s 2 x 2 +~.+s n x n +... . 
t For an alternative proof see Examples XVI, 8. 
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Hence, when 0 < x < l, 

= (® 0 — ' *)+(«!—' s)z n +..., ( 3 ) 


and so, by (1) and (2), and by the use of Theorem 8, 


f(x)- 


< 2iT(l+a+...+^* v " 1 )+^x iV +^ v+1 +...) 




uV 


_ ~N 

= 2A’- - +eJc^~. 
l—x l—x 


Accordingly, -when 0 < x < 1, 

\f(x)~s\ < 2K( l-x*)+eh. (4) 

But, N being fixed, as also are e and h, 

3 X . l—x N < eh when X < x < 1 . 

In (2) fake h = l/(2X-fl). We then see that 

€ > 0; 3 X . [/(re)— $| < € when X < z < I, 
that is, f(x) -* s as £ 1—0. 

4.3. The reader will see that the proof in 4.2 consists of 
writing down (3) — which is simple algebra apart from the use 
of Theorem 27 — getting an eh j (l—x) out of (2) for n ^ N and 
getting a multiple of eh for the terms not so dealt with by taking 
x sufficiently near to 1 . 


5. Multiplication of series (continued) 

Theorem 30. If c n is defined as 

a i b n + a 2 b n _i+ . . . +ci n b v 

( CO \ t 00 \ 00 

2 a n)\ 2 b n ) =2 c n whenever all three series are con - 

n = l ' '71 = 1 * n = 1 

vergent. 

Let each of the series £a n , 2 ^ n , 2 c n he convergent; let 
their sums be A, B, C. Then the series 

2 a n x ’ l ~ 1 ’ f b n X n ~ x 

n—1 n= 1 

are absolutely convergent (Theorem 28) when 0 < x < 1, and 
their product (Theorem 27) is then 

2 c ’n xn ~ X - 

n~l 
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Rut, by Theorem 29, 2 a n x7l ~ 1 2 ^n xU ~ x and 

2 -> C as x -> 1 — 0. Hence, by the analogue of 

Chapter VI, § 1.1, AB = C. 


Examples XV 


1. Prove that 


!!*-5*'+r , -T - 2 <- 1 >'( l +5- t -+ A)f 

71 = 2 

(a) when \x\ < 1 , (6) when x = 1 . 

[Assume in (6) that + ••• + “) °-] 

2. Assuming the expansion 

tan -1 # = x — J^ 3 -rJ^ 5 — ...» 

prove that 

X < - 1> ’SqS( 1 +5+-+sAi)- 

71 = 0 

Prove that the series are absolutely convergent when \x\ < 1 and are 
convergent when x = 1 . 

3. By first putting x = — y in Examples XIV, 10, show that 

2~ r “ 1 = f (-l) n A r n 

71 = 0 

when r is a positive integer. 

4. Prove that each of the series 


x— £x 2 +lx* — £z 4 -f 
x— hc 3 -ffz 5 — ... 

is absolutely convergent when |#| < 1 and that the functions they 
represent tend to the sums of the series 

1 — J + J — i + ••• , 

as x tends to 1 from values less than 1. 

5. Consider the validity of (2 a »)(2 ^n) = 2 c n> where 
c n = a l b n J ra z b n _ 1 -\- ...+a n b v 

in the three cases 

(i) a n = b n = n~ 2 , (ii) ci n — b n — ( — l) n n _1 , 

(iii) a n — b n — ( — l) n n -1 / 2 . 



CHAPTER XI 
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Foreword. This chapter is rather long. The reader may find the 
following plan useful on a first reading. Master §§ 1, 2; get a first, rough 
idea of the theorems in §§ 3, 4, 5 ; see how these theorems apply to some 
of the examples at the end of the chapter ; make a more careful stud> 
of §§ 3, 4, 5. Theorems 36, 37 should be omitted on a first reading. 

1. Preliminary discussion 

We have proved that we can add and subtract (Chap. VI, § 3) 
convergent series, and that we can multiply them together when 
certain conditions are satisfied (Chap. X). We now start on the 
problem 'When can we integrate and differentiate infinite series?’ 

Suppose w r e know that, for each and every x such that 
a < x < 6, the sequence 

cc n {x) {n = 1,2,3,...) 

tends to a limit. This limit depends upon x; let it be denoted 
by a(x). Then what we know is this: if we first fix x, then 

e > 0; 3 N . |a(x)— oc n {x)\ < c when n ^ N. (1) 
If we move to another x and keep the same e, then the state- 
men ^ |a(:r) — & n {x)\ < e when n ^ N 

may cease to be true if we keep the same N : w r e may need to 
take a larger N for the statement to be true. This possibility 
that N will grow bigger and bigger as w^e move to different x 
will lead to difficulty in many problems. So, to cut out all such 
difficulty, w T e consider a different type of convergence, namely, 
'uniform convergence in an interval ( a,b ). We say that a n (x) 
converges uniformly in the interval (a, b) to the limit a(x) if 

e > 0; 3 N . \oc{x)—cc n (x)\ < € when n ^ N and a ^ x < b. 

( 2 ) 

In (2) there is no question of first fixing x; we fix the interval 
(a,b) and not any special x in it, and then (2) says Tf we put 
down any positive number e whatsoever, there is some number 
N such that |a(a;)— oc n (x)\ < e -when n ^ N, no matter what 
x of a < x < b we consider’. 
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2. Formal definitions 

2.1. It will be convenient to make precise the meaning of 
'interval 5 . Geometrically, an interval on a straight line con- 
sists of all points lying between two fixed points, the ends of 
the interval: sometimes we want to think of the end-points 
as belonging to the interval (a closed interval), sometimes we 
want to exclude the end-points from our consideration (an 
open interval). Analytically, the definitions are 
The closed interval (a,b) consists of all numbers x such that 
a ^ x <6. The openi interval )a 3 b{ consists of all numbers x 
such that a < x < b. 

In this book ' interval 5 will mean ' closed inter vaV unless the 
contrary is stated. The phrase 'all x in (a, b) 5 will mean 'all 
numbers x such that a ^ x < b\ 

Uniform convergence can be defined with respect to a closed 
interval, an open interval, or indeed with respect to any set 
of values of the variable x. But we shall, for simplicity, confine 
our attention to closed intervals. 

Definition of uniform convergence in an interval. The 
sequence a^rr) is said to converge uniformly to the limit oi(x) in 
the interval (a, b) if 

c >0; IN. for all x in (a, b), |a (x)~oc n (x)\ < e whenn ^ N. 

A less emphatic form of the last line is 
e > 0; 3 N . | oi(x)—a n (x)\ < e when n ^ N and a < x < b. 

The reader may use either so long as he holds firmly to the 
fact that e having been set down, it is possible to find an N that 
governs the whole interval. 

The series u 1 {x) J r u 2 {x) + . . . + u n (x ) + . . . 

is said to converge uniformly to the sum s(x) in the interval (a, b) 
if, with s n (x) = u x {x)+ ...+u n {x), 

e>0; 3 N . for all x in (a, b), |s(a:)— s n {x)\ < e whenn^N. 
That is, the sequence s n (x) converges uniformly to s(x) in (a, b). 

t The brackets open outwards to denote an open interval. 
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2.2. An example. Consider the sequence 
x n (n — 1, 2, 3,...) 

when 0 < x < I. If we fix x, then x n ~>0 as n~^co. If we 
fix a definite number 3, as near 1 as w’e please but less than it, 

^ ieEL x n ^ 3 71 when 0 ^ x ^ S. 

Since 3 71 0 as n-> oo, 

6 > 0; 3 JV . S n < € when n ^ N, 

and so 3 N . for all x in (0,8), \x n \ < e wdien n ^ A 7 . That 
is to say, the sequence {x n ) converges uniformly in (0,3) to the 
limit zero. 

The reader will see for himself that the argument breaks 
down completely if 8 = 1 : there is not uniform convergence in 
(0, 1), though there is in any (0, 3) wdiere 0 < 3 < 1. 


3. Properties of uniformly convergent series 
3.1. Integration. Theorem 31. If the series 

n (o;) + ... (1) 

converges uniformly to the sum s(x) in the interval (a, 6), then 
f 00 r 

s(x) dx = J u n {x) dx (2) 

J n — 1 

a a 

provided s(x) and each u n (x) can be integrated over {a t b). 

The process of forming the R.H.S. of (2) is usually called 
integrating the series (1) term by term; the theorem itself may 
be expressed in the form l A uniformly convergent series may be 
integrated term by term over a finite range I 
Consider the graphs 



Fig. 1. 
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n 


o 



3 

Fig. 2. 


7 


x 


wherein the curves y — s(x), y ~ s n (x) are shown in typical 
relative positions: s a (x) = u 1 (x)+...+u n {z). 

Since the series converges uniformly to the sum s(x) in (a, 6), 

e > 0; 3 N . for all x in (a, 6), 


1*0*0— « n 0*0l < r~ 

o — a 


when n ^ N. 


That is, the vertical distance between the two graphs is less 
than e/ib-a) at every point, and so the area between the two 
graphs is less than e. Hence, if n ^ N, then 

b b 

J s(a;) dx — J s n (x) dx , 

a a 


which is less than (Fig. 1) or equal to (Fig. 2) the area between 
the graphs of y — s(x) and y ~ s n (x), is less than e. Hence 

b M b 


e > 0; 3 N 


f s(x) dx — 2 f u r( x ) dx 
j r = i y 


< € when n ^ N, 


that is, the series of integrals converges to the integral of s(x). 


For readers whose knowledge of integral calculus is sufficiently 
advanced the following proof is given. 

By hypothesis, 

€, k > 0; 3 N . js(x)— s n (a;)| < ek when n > N and a < x < 6. 

When n > N 

. b b | j b . 

J 8{pc) dx — J 8 n {x) dx\ — | J {s(z)-~s n (a;)} dx\ 

a a ' a 

b 

< J K#) — 5„(^)| dx < ( b—a)Jc € . 

a 


(The modulus of the integral of f(x) < the integral of | /(#)].) 
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Take k — 1/(6— a), and we have 

b b 

€ > 0; 3 N . j s{x) dx — j 8 n (x) dx I < £ when n > N, 

•a & 

and so the series of integrals converges to the integral of s(x ). 

3.2. Continuity. A function f(x) is said to be continuous 
at x = a; 0 if 

c > 0; 3 8. !/(«)— /(a: 0 ) | < e when \x— x 0 \ < 8. 

That is to say, given £, there is a 8 such that f(x) is within 
€ of f(x 0 ) whenever x is within 8 of rr 0 ; or, again, on using the 
notation of Chapter X, §4.2, f(x) ->f(x Q ) as x -> cc 0 . 

We shall make only occasional use of continuity, but it is 
impossible to give clear enunciations and proofs of some 
theorems without using it. We shall assume, without proof, 
that if f(x) is continuous at every x 0 in (a, 6), then f(x) can be 
Integrated over the whole or any part of (a, b ), and, if 

X 

F(x) = J f(t) dt (a < x < b), 

a 

then F'(x) = /(#). We assume also (what can be proved as an 
exercise) that the sum of a finite number of continuous functions 
is itself a continuous function. 

Theorem 32. If each u n {x) is continuous in (a, 6) [that is , 
continuous at each x Q in [a, 6)] and 2 u n (x) converges uniformly 
to a sum s(x) in ( a 3 b ), then s(x) is continuous in )a, b( ; also 
s(x) -> $(a) as x a+0, and s(x) -> s(b) as x-> 6—0. 

Let x 0 be any given x in (a, b). By hypothesis, 

€, k > 0; 3 N . js(#)— 5 A t(o;)1 < eh when 
Hence, for any x in (a, 6) other than x Qi 

l*(*)— * W i < !«(*)—%(*) j + \s N (x)—s N (x 0 ) I -f kv(z 0 )— s(x 0 ) I 
< 2ek+\s N {x)-s N {x 0 )\. 

But N is a definite, finite number and so, by hypothesis, s N (x) 
is continuous in (a } b). Hence 

3 8 . \s N {x)—s N (x 0 )\ < ek when \x—x 0 \ < 8. 

Hence, on taking k = 

€ > 0; 3 8. |s(se)— a(cc 0 )| < € when \x— x 0 \ < 8. 
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3.21. Problem. In the proof of Theorem 32 we have used nearly 
the full force, but not quite the full force, of our hypothesis 
that 2 u n( x ) converges uniformly to the sum a{x). What have 
we found it unnecessary to use? 

3.3. Differentiation. Theorem 33. If 2 u n (z) converges for 
all x in {a,b), and if each u n (x) has a continuous differential 
coefficient in ( a,b ), then 

Jj: 2 «»(*)} = 2 <(*) {a <X< b), 

' provided the series of differential coefficients is uni- 
formly convergent. 

Let 2 u n( x ) = @( x ) 2 u n( x ) = F(x). By Theorem 32, 

G(x) is continuous and so, if a < x < 6, 

X 

J- J G(t) dt = <?(*). (1) 

a 

By Theorem 31, since 2 converges uniformly in (a, #), 

J G(0 dt — 2 J <(<) dt 

a a 

= 2 K(*)~ «*(«)} 

== r(x)-r(a) 

(by the subtraction of two convergent series). 

By (1), gjW*)} = <?(*). 

3.4. General Note on Theorems 31, 33. The conditions 
we have given are sufficient to prove the theorems. It is not 
necessary that a series should be uniformly convergent for 
term-by-term integration to be valid: nor is a continuous 
differential coefficient necessary to the truth of Theorem 33. 
We have confined ourselves to the simplest and most common 
circumstances. 

The following examples, taken from Bromwich, Theory of 
Infinite Series , illustrate the fact that not all series can be 
integrated or differentiated term by term. 
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Example 1 . For the sequence 

s n [x) = nxe~ nxl (n = 1,2,3,...), 

s(x) = limit of s n (;r) when n -> co, a; being fixed, = 0. The graphs of 
y = s n (.r) have the general form shown: 



the larger n is, the steeper and the closer to the y-axis is the ascent. 
The top of the peak is at a height V(i ne_1 ) and its abscissa is ^{{rr 1 ). 
For each fixed positive x the sequence s 2 (a),..., tends to zero 

as n tends to infinity. But the nearer x is to zero, the larger must we take 
N if, for n > A r , all s n (a;) are to be small. [s n (x) only settles down to being 
small after it has passed its peak and it will be no good considering any 
N which does not make JdN" 1 ) < x.] Hence there is not uniform con- 
vergence of s n (x) to its limit zero in (0, 1). 

l 

s(x) dx = 0, since «$(#) is itself zero. 

6 

i 

But | s n {x) dx = K~ e ~ nx X = J(l — e" w ), 

o 

and this -> J as n -> go. 

Example 2. For the sequence 


S " ix) = T+nW ( n=1 * 2 ’ 3 >-)> 


$(a;) = 0 and so s'(x) — 0. Also 


n(l —n 2 x 2 ) 


nV ; (1-fnV) 2 * 

When x # 0, s' n (x) -> 0 as n -> oo and the formula 
s'(x) = lim s' n (x) 


is true. But, when x = 0, s' n (x) — n and — > oo as n —> oo. 

Here it is that does not converge uniformly in an interval that 
contains x = 0. 
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4. The general convergence principle 

We now state the condition for uniform, convergence in a 
form that does not presuppose a knowledge of what 5 (a:) is. 
The theorem that follows is an extension of Theorem 19. 

Theorem 34. The necessary and sufficient condition that the 
sequence s n (x) should converge uniformly to a limit in the interval 
(a,h) is that 

e > 0; 3 N . for all x in (a,b) 
\s x (x)—s x+p (x)\ < € for all positive integers p. 

To prove that the condition is necessary: In Chapter VIII, 
§1.2 replace ‘3 IV 75 by '3 N for all x in (a, 6)’; the remaining 
details are unaltered. 

To prove that the condition is sufficient: If the condition is 
satisfied, then, for each fixed x in (a, b), the sequence must 
converge to some limit (Theorem 19). Let this limit be denoted 
by s(x). By hypothesis, 

€ > 0; 3 N . for all x in (a,b) \s N (x)—s v + p (x)\ < k. (1) 

That is, 5 v (a;) — < « v+p (a0 < 

and so 5 v (a;)— k < $(#) < UvM+i 6 (Theorem 2). (2) 

By (1) and (2), |s(a;)— s N+p (x)\ < € whenp is a positive integer. 
Hence the condition is sufficient to ensure the uniform con- 
vergence of s n (x) to some limit «s(#) in (a, b). 

Corollary 1. If s n (x) is the sum of the first n terms of an 
infinite series 2 u n (x), then 

M*)— %+p(*)l = l“,v+i( a; )+-+Mjv + p(a:)l- 
Hence the necessary and sufficient condition for the uniform con- 
vergence in ( a } b) of the series 

u i(%) + u 2 (x )+...+' u n (z) + • • • 
is that <= > 0; 3 N . for all x in (a,b) 

Kv+iW + * • • + ( x ) i < € for all positive integers p t 

Corollary 2. If the series of absolute values 2 \u n ( x )\ con- 
verges uniformly in (a, 6), then so does the series 2 u n( x )' 



90 UNIFORM CONVERGENCE 

5. Tests for uniform convergence 

5.1. The M test of Weierstrass. Theorem 35. The series 
2 u n (x) is uniformly convergent in (a, b) if we can find a con- 
vergent series of positive constants 2 such that 

\u n (x)\ < M n when a <6. (I) 

Since 2 ^-4 * s convergent, we know that 

€ > 0; 3 N . ! 3/y +1 +••*"+■ Af v +p I < * 
for every positive Integer p (Theorem 21). But 
Nv+l( x ) + *- + W A r +p( a: )l 

IW*)I+-+IW*)I 

^ -Xv+l +•• ,+Mx+p when a < x < 6, 
by hypothesis. Hence 

e > 0; 3 N . for all x in (a, 6), 

Kv+i fa) + • • • + u N+p (x) ] < c for every positive integer jp, 
and so 2 u n (x) is uniformly convergent in (a, b ). 

5.2. Notice that, by using (1), the onus of finding an N has 
been removed from 2 u n ( x ) altogether; the onus of finding N is 
placed on 2 Af n , a series of constants. 

5.3. Birichlet’s test. Theorem 36. Let 

s,i( x ) = a 1 (x)+a 2 (x)+...+a n (x); 
let v n (x) be monotonic decreasing in nfor each fixed x in an interval 
(a } b). Then 2 a n( x )v n {x) is uniformly convergent in (a, b) pro- 
vided that 

(i) 3 K . | s n (x) | < K for all n when a < x < 6, 

(ii) v n (x) 0 uniformly in (a,b). 

By hypothesis (ii), 

e,k > 0; 3 N . for all x in (a, 6), \v n (x)\ < eh when n > N. 

Also, by Abel’s lemma (cf. the proof of Theorem 24), 

\ a N + i( x )v N+1 {x) + . . . + a N+p (x)v x+p {x) 1 < 2K\v N+1 {x)\ < 2Kke. 

The uniform convergence of f>,a n {x)v n {x) follows from 
Theorem 34 if we take k = 1/2 K. 

Corollary. The theorem is also true when v n (x) is monotonic 
increasing in n for each fixed x and tends uniformly to zero 
{through negative values) in (a, 6). 
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5.4. Abel’s test. Theorem 37. Let v n (x) be either monotonic 
decreasing in n for each fixed x in (a, b) or monotonic increasing 
in n for each fixed x in (a, h). Then 2 a n (x)v n {x) is uniformly 
convergent in {a, h) provided that 

(i) 2 a n( x ) i s uniformly convergent in (a, 6), 

(ii) 3 K . \v n (x)\ < K for all n when a < x <6. 

Since v n (x) is bounded and monotonic in n for each fixed 
x in (< a , 6), it must converge to a limit, v(x) say. Write 

u n (x) = v(x)—v n (x) or v n (x)-v(x) 

according as v n (x) is mi. or m.d. Then u n (x) is positive (or 
zero) and is m.d. Also, by hypothesis (ii), 

\v(x)\ ^ K when a ^ x ^ b. 

Hence \u n (x)\ < 2K for all n w r hen a ^ x ^ b. 

By hypothesis (i), 

e 3 h>0; 3 N . \a N+1 {x)+...+a N + p {x)\ < efc 

whenever p is a positive integer and a < x < 6. 

Hence, by Abel’s lemma, 

!%+i( a :)%+i( a: )+-+% +P (^Kv +? (*) I < eku N+1 {x) < 2<=M\ 

On taking k = 1/2 K we see that (Theorem 34) 2 a n (x)u n (x) is 
uniformly convergent in (a, 6). 

Also, since |v(a;)| < K, it is easily shown (by Theorem 34) 
that 2 a n( x ) v ( x ) * s uniformly convergent. The uniform con- 
vergence of 2 a n( x ) v n( x ) follows by the analogue for uniform 
convergence of Chapter VI, § 3. 

5.5. In many applications of these theorems either a n or 
v n does not vary with x. Suppose 2 a n ^ a convergent series 
of constants; then, for the purposes of Theorem 37, it is to 
be thought of as a series that is uniformly convergent in any 
interval whatsoever. 

5.6. We shall state the analogues of Theorems 24a and 25 a, 
and leave to the reader the task of amending the proofs so as 
to cover uniform convergence. 
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Theorem 36 a. Let sjx) = afx)-^ ...+a n (x). Then 
1 a n (x)v n {x) 

is uniformly convergent in an interval ( a,b ) if 

(i) 3 K . \s n (x)\ < K for all n when a ^ x < b } 

(ii) ^ ] v 7i ( x )— ^n+iW! is uniformly convergent in (a,b), 

(iii) v n {x) 0 uniformly in (a, b). 

Theorem 37 a. 2 a n ( x ) v n ( x ) i s uniformly convergent in an 
interval (a,b) if 

(i) uniformly convergent in (a 3 b), 

(ii) 2 ! l, n(‘ T )““ t n+i( a: )l is convergent and its sum is bounded in 
(a,b), 

(iii) 3 K . \v n (x)\ < K for all n when a < x < b. 


Examples XVI 


1. On Theorem 35. (i) Prove that 

x n 


2 X n 

n 2 ' 


2 ; 


2 


x 2n -\-n 2 


/ w(n-f- 1)’ 
are uniformly convergent in ( — 1, 1). 

(ii) Prove that, if 8 is any fixed number greater than unity, 

2 ~x n ' 2 l+z'*’ 2* n (i+» n ) 

converge uniformly with regard to all x > 8, i.e. prove that 

€ > 0; 3 N . |s(x)— $ w (x)| < € when n > N and x > 8. 

(iii) Prove that, if 8 is any fixed positive number less than unity, 

2£ n > 2 (rc+i) -1 # 71 , 2( n +i)£ w > 2 n3;rn 

converge uniformly with regard to x in (—8,8). 

(iv) Prove that 

2 ri 4 + n 2 # 2 * 2 n 2 -f n 4 x 4 

converge uniformly in (—A, A) whatever real value A has. 

Hints, (i) x 2n -\-n 2 > n 2 , x 2n (x 2n -j~n 2 )~ 1 < n~ 2 when |x| ^ 1. 
(ii) |x -n j < 8~ n and 2 § -7Z is convergent. 

(iv) n 4 +n 2 x 2 > n 4 . 


2. On Theorem 36. If (v n ) is a monotonic sequence of positive con- 
stants that converges to zero, then each of the series 2 v n smnd , 
2 v n cos n6 is uniformly convergent with regard to d in the interval 
(8, 277—8), where 8 is any fixed positive number less than 277 . 
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3. Prove that each of the series 
sinra$ 


is uniformly convergent with regard to 6 in (S, 2tt— 8), where & is any 
fixed positive number less than 277, and that each of the series 
'SU sin nO 'ST cos nd 


is uniformly convergent with regard to 6 in (0, 277 ). 

4. On Theorem 35. Prove that the series 


1 2 2 — 1 4 2 — 1 1 6 2 — 1 "• 

is uniformly convergent with regard to x in x > 0. 

5. On Theorem 33. If the sum of the series in Example 4 is f(x) y 
prove that f"(x) is given correctly by differentiating the series twice 
term by term when x > 8 > 0. 

6. On Theorem 31. Prove that 


JGSK-Zsw 


7. On Theorem 37. By considering v n (x) = x n t prove that a n xU 
uniformly convergent in (0, 1) provided that 2 a n * s convergent. 

8. On Theorem 32. Prove Theorem 29 by using the result of 
Example 7. 

9. On Theorem 35. Prove that the series 

1 2a ,2 a _ 

e — r^cos.T-f — — — cos 2a;— ... 

a a 2 — l 2 a 2 — 2 2 

is uniformly convergent in any finite interval of values of x . (Hint. 
|a 2 — n 2 \ = |n 2 — a 2 | > Jn 2 when n exceeds a certain N.) 

10. Discuss the'uniform convergence of 

l+x n ) 

for real values of x. 

11. Extension of Theorem 31. If the conditions of Theorem 31 are 
satisfied and |F(#)| < 1 for all a? in (a, h) t then 


J s(x)F(x) dx = 2 J u n( x )F{x) dx 


provided s{x)F(x) and u n (x)F(x) are integrable over (a, 6). 



CHAPTER XII 


BINOMIAL, LOGARITHMIC, EXPONENTIAL 
EXPANSIONS 


1 . The binomial theorem 
1.1. We assume the elementary theorem that 


(l+x) n 
— 1 + nx 


n(n—l) 
' 2 ! 


**+... + ^- 


n(n—I)...(n— r-f 1) 


# r 4-.,.-j-a; n 


(i) 


when n is a positive integer. It can be proved by induction. 
We use the notation 

to denote 

when r is a positive integer, whether n is an integer or not. 
Sometimes, for convenience, we use 

to denote 1. 

Notice that, if n is a positive integer less than r, then 
is zero. 

1.2. As a preliminary to our first proof of the binomial 
theorem when the index is not a positive integer, we now prove 
an identity usually known as Vandermonde’s theorem. 

Theorem 38. If r is a positive integer , then , for all values of 
m and n, 



When m and n are both positive integers, (2) follows by 
assuming (1) and equating coefficients of x r in the identity 

frn+n\ = ( 1 +a .)m+n = (i+a;)>».(l+a:)» 

r~Q \ T I 
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Now consider n, r to be fixed positive integers. Then 



is, as we see by writing out the terms in full, a polynomial of 
degree r in m. But, by (3), wherein m and n are any positive 
integers, it vanishes when m = 1,2, 3,...,r+l. That is, the 
polynomial (4), of degree r in m, vanishes for r+1 values of m. 
Hence (4) is identically zero when n, r are fixed positive integers. 

Now let r be a fixed positive integer and let m be fixed 
(integer or not). Then (4) is a polynomial, of degree r in n, that 
vanishes when n = 1 , 2,...,r-f 1 , that is, for r+1 values of n. 
Hence (4) is identically zero when m is fixed and r is a fixed 
positive integer. 

Hence, when r is a fixed positive integer, (4) is zero for all 
values of m and n. 

1.3. Theokem 39. If — 1 < x < 1, the series 

f(x,n) = l+^4- n - ^~ 1 - ^ a; 8 +...+^jx r +... 

converges for all real values of n (it stops at the (n-{-l)th term if 
n is a positive integer) and its sum is the real positive value of 
(1 +*)*.* 

e.g. when n = \ the sum of the series is the positive fourth root 
of l+x. 

By d’Alembert’s ratio test, the series 



is convergent for all real n when \x\ < 1. By the multiplication 
of absolutely convergent series (Theorem 27), 

co 

f(x,n).f(x,m) = 2 c,* r , 

r — 0 

.here (7) + ( r “)(») + ... + £) (^) + If), 

whenever m } n are real and \x\ < 1. 
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But, by Vandermonde’s theorem, c r = r?i j. Hence, when 

i x \ < 1 > 

f(x,n).f(x,m) = 

By induction 

/(ar, n) . /(r, m)...f(x, A) = /(.r, m-fw+ ...+A), 

{/(x, w)} fc = f(x. nk) (k a positive integer). (6) 

Further, f{x,n).f(x,—n) —f(x,0) = 1, ( 7 ) 

since the series for f(x,n) reduces to 1 when n = 0. 

If n is a positive fraction plq, then (6) gives 
{f(x,plq)}i =f(x,p) = (l+.r)P 

since p is a positive integer. Hence, when |xj < 1 [(5), (6), (7) 
have been proved only when this condition is satisfied], 
f{x,Pi'q) is a value of (1 +x)p/«. 

Moreover, if 0 < 8 < 1, the series for f(x,n) is (by the M test) 
uniformly convergent in 0 < |x| sg S: each term is continuous 
in x, and so, by Theorem 32, f(x,n) is continuous in (—8,8). 
But f(0,n) — 1, and so f(x, plq) is that value of (1 +z)p/« which 
tends to 1 as x tends to zero; and this value is the positive gth 
root of (l+x) 2 ’. 

In virtue of (7) the same result holds when p is replaced by 
—p. Hence, if n is a positive or negative rational number, 
and — 1 < x < 1, then 

l+n.r-| — — -£ 2 +...-t-|”jaf+... == (l+.r)' ! (\x\ < 1), 

the positive root being taken. 

The proof of the theorem for n not rational, by means of a 
limiting process, is not an easy proof. A proof by a different 
method will be given after we have dealt with the exponential 
function. 


aj 

2 

r — 0 




■■ f{x,m+n). 


(5) 


2. The exponential function 
2.1. We define e to be the sum of the series 

1 + 1 +^j + ^+... + ^ 1 + . 


n\ 


(8) 
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and consider the series 

/*v»2 /y»3 /vtl 

1 +* + f i + f ] + ...+| I + .... (9) 

The series (9) is 

(i) absolutely convergent for all values of x, 

(ii) uniformly convergent in any finite interval (—A, A). 
(The series 2 A n jn\ converges, by Theorem 10, and (ii) follows 
by the M test (Theorem 35).) 

Let E(x) denote the sum of the series (9), so that E( I) == e, 
E( 0) = 1. 

2.2. The relation between E(x) and e x . Rational 
numbers. By the multiplication of absolutely convergent 
series (Theorem 27), 


E(x).E(y) 


x r ~ L y 


x r ~ 2 y 2 


ri 

r = 0 v 

y (*+y> 

' Z* r\ 


(r — 1)! 1! 1 (r — 2) ! 2! 
= E(x+y), 


r = 0 

for all real values of x and y. As in the proof of 
expansion, this gives 



the binomial 



E(n) = {E( \)} n = e n , 

= a value of%J(e p ) i.e. of e p!a , 


(10 a) 
(10b) 


e(^).e(-^) = E(0) = 1. (10c) 

W V 27 


That is to say, when x is a rational number, E(x) is a value of 
e x , and, by continuity, it is that value of e x which 1 as x -> 0. 

Irrational numbers. Since the series (9) is unaltered when 
it is differentiated with regard to x, the differentiated series 
converges uniformly in any finite interval {—A, A). Hence, by 
Theorem 33, 

A-E(x) = E(x); 

also, for any given x, E(x) is a finite number. That is to say, 


E(x-\-h)—E(x) 

h 


a finite limit as h -> 0. 


Accordingly, E(x-\-h) must tend to E(x) as h -> 0; for if it did 
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not, then {E(x+h)~ E{x)}/h could not tend to a finite limit. 
(In words, a function with a finite differential coefficient must 
be continuous.) 

If x is irrational and (a n ) is a m.i. sequence of rational numbers 
that tends to x, then, by what we have proved, 

E(x) = lim E(oc n ) = lim e 0 ^. (11) 

X n -+X U n -+X 

It is now a matter of indifference whether 

(i) w r e define e x as E(x) and deduce e x — lim e a «, 

(Xn-^X 

or (ii) w r e define e x as lim e** and deduce e x = E(x). 

With either definition we have e x xe y = e x+y , e x > e y when 
x > y, e Xn -> e x when x n -> x 3 and so on. 


3. Logarithms 

It follows from (10) and (1 1) of § 2 that 

e v is positive if y is real. (12) 

If e y = x, we write y — log x, thus defining the logarithm of 
any positive number. By the differential calculus 


1 = e y 


dy 

dx 


or 




Also, log 1 == 0 since E( 0) = 1, so that, when x > 0, 


J J = log*, 

1 

an equation which is frequently taken as the definition of a 
logarithm. 

Prom § 2 it follows that, when x v x 2 are positive, 
log(3 x 3 2 ) = 1 ogx 1 +logx 2) 

and so on. There is one detail which should be noted particu- 
larly, and that is 

‘if log x n -> y, then x n -> e y \ 

To see the truth of this statement, let log x n = y n , so that y n y 
and x n = e y ». But, as we saw in § 2.2, E(y+h) E(y) as h 0, 
and so E(y n ) -> E(y) as y n -> y\ that is, -> e v . 
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4. The function a x when a is positive 

Rational index. If x is a rational number, pjq say, then 
aph = fe losa )Pfo (by the definition of logarithm) 

= {E{loga)}vto 
= E{(p/q)log a) ~ 
by the results established in §2. 

Irrational index. If x is an irrational number we take 
e xioga as our definition of a x . Thus, whether x is rational or 
irrational, aX _ e xioga (13) 

If x is an irrational number and (a n ) is a mi. sequence of 
rational numbers that tends to x, then, by (11), 

lim (a 0 ^) = lim (e a « loga ) = e x 108 a = a x . 

CCn-+X Ct n -*X 

We also have a x xa y = a x+ v, and so on, whether x , y are rational 
or irrational. 


A point in the differential calculus. When x. is positive 
and n is any real constant we have, using the equation (13), 



e nlogx ,n-^-(logx) 

(XX 


= x n . — = nx 71-1 . 
x 

Thus if z > — 1, and if p is any real constant, then 

^(1 + *)" = Ml+2)'- 1 ^^ = ^(1+2)^, (14) 

a result of fundamental importance to the work that follows. 


5. The binomial theorem for any real index 
The proof we are about to give is one that depends, essen- 
tially, on a prior establishment of (14). The point is of some 
logical interest: we can, if we so wish, find a proof of the 
binomial theorem for any index and then use the binomial 
theorem in proving (14) for any index; alternatively, we can 
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make our proof of (14) independent of the binomial theorem and 
then use (14) to prove the binomial theorem. Some care is 
necessary to ensure that we do not use each to prove the other. 
Consider the series 


t \{A\~r 


I+/x£-f- 


where ^ is any fixed real number. 

If k is any fixed positive number less than unity, and if 
~~k < x < Jc, then i / \ j i / \ j 


n* < r *•. 


fA brj_ ( P \ br+ 1 _ r ~?~* 1 _> I 
r) • \r+l) fM~r k k 


as r -> oo. 


Hence, by Theorem 10 and the M test, the series (15) converges 
uniformly in (— k, k) for any fixed p. 

The series obtained by differentiating (15) term by term is 

H l + (fA—l)x+... + ^ L ^ l ^jx r +... 

and so converges uniformly in (■— fc, k). Hence, by Theorem 33, 
if f(x) denotes the sum of (15), and if ~k < x < k, then 


r = 0 x 7 


But, ifr ^ 1, then 


M— , (p— i 
r / ‘ \r— 1 


Hence f'(x)+xf'(x) = M [l + J { r ) z j > 

that is, (1 -\~x)f'(x)— jxf(x) = 0. 

Hence, assuming that (14) is true (as we have proved it is), 

df M \ _ n 


Hence 


fix) = A{ i+xy. 
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where >4 is a constant, independent of x. But/(0) = 1. Hence, 
if by (l-rx)^ we mean the real positive value of which 

reduces to 1 when x = 0, then A = 1 ; and so 

(l+xy=l+fix + f^^x*+... + l^y+... (16) 

for all real values of /x. 

Finally, (16) has been proved when —k<x< Jc and h is 
any fixed number less than unity. Hence (16) is true for every 
x such that —1 < x < 1. For, if we take any definite x in 
)— 1, 1(, we can choose a h less than unity so that this x lies 
in )—h, k(. (The statement becomes obvious on drawing a line 
and marking the points — 1, x, 1 on it.) 

6. General remarks on §§1-5 

We have tried to give a logical framework for the develop- 
ment and interdependence of the binomial, exponential, and 
logarithmic functions. We have made no attempt to develop 
all the properties of exponential and logarithmic functions from 
the definitions. The reader will probably be familiar with these 
properties. He can, if he so wishes, develop them, and that 
without any serious difficulty, from the definitions here adopted. 


7. The binomial series when x = 1 and when x = — 1 
We have seen that, when — 1 < x < 1 and /x is real, 

l+^+^^x 2 +...+(fyx n +... ( 1 ) 

is (absolutely) convergent and that its sum is the positive value 
of (1+#)^. When x = 1, the series becomes 


1 1 , /fOful) , , fxfc.— !)...(/*— tt+1) 

2 ! +•"+ n \ 


( 2 ) 


When n exceeds 1, the factors jjl— n+1, /x— are all 
negative, so that the terms of (2) are ultimately of alternate 
signs. Write 


v n = 


/ M-l) 

n\ 


Then w r e have 


v n __ nJ r 1 n+_ 1 x , aH-1 

v n + 1 p—n n—fjL /x* 
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Hence, if /x+1 > 0, the sequence (v n ) is m.d. when n > p. 

Also, when n > /x > — 1, 

, , , 1 1 

n— a <71+1 and > — — , 

n — /x 7i+l 


so that 



> l + (/i+l)[ 


\7l +1 71 + 2 


. / x + 1 \ 

~ r ^+W 


(3) 


Now let p ->oo, keeping n fixed. Since 2 (V 71 ) * s divergent, the 
expression (3) -> co as p -» cc, and so v w+p -*» 0 as p -> oo. 

Hence the sequence (v„) is ultimately m.d. and v n -> 0 as 
7i — > oo. Hence, by Theorem 18, 2 (— l) 7i v» is convergent; that 
is, the series (2) is convergent if /x+1 > 0. Further, when 
0 < x < 1, the sum of the series (1) is (!+#+ and 2^ as 
x-+l from values less than 1. Hence, by Theorem 29, the sum 
of the series (2) is 2^ when /x+1 > 0. 

We have thus proved that, when /x > — 1, 

l+M + ^++- + Q + - = 2^. (4) 


When x = — 1 the series ( 1 ) becomes 


1— /x 


1 ) 

2 ! 


(5) 


This series we have considered in Examples VII, 1. It is con- 
vergent when /x > 0., By Theorem 29, its sum is given by 


lim (1— #)+ 

x-*l 


Hence, when /x > 0, 

1— M 


2 ! 


i.e. 0. 

-... = 0 . 


( 6 ) 


8. The logarithmic expansion 
As we have seen in § 3, 

fde. 

J -j = logo: (* > 0). 

1 
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Put x = 1 +y 3 0 = 1+2, and we get 


v 

J 


dt 

1+7 1 


log(l+y) (y > — 1). 


By elementary algebra, 


or 


1 

* = 1 +Z+...+ Z »-l, 

I — z 

rb = 1 +*+-+^+ I = i . 


On writing z = —t 3 this becomes 
1 


t n 


1 — t+t 2 - ... + (-t) n - 1 +(— l) n - 
1+2 > -TK J l + t 


Hence 


iog(l+s) - !/-§+^ + -+(-l)”-'f+(-l)" J ££ 

0 

But, w r hen y > 0, so that 1+2 > 1 throughout the range of 
integration, 


i y ; v 


y n + 1 

tt+T 


0 0 

and this -> 0 as?i->ooif 0 < 2 /< 1. 

Also, if 0 > y > — 1, so that 

1+2 > 1 +y > 0 

throughout the range of integration, we have 


v 


{—)H 7 1 dt 


1+2 


< 


i+yj 


\y\ 

It, it- M** 1 

- (.+ !)(!+,)’ 


which -> 0 as n -> oo. (Notice that the argument breaks down if 
y=-l.) 

Hence, if —1 < y 1, the series 

y-\y i +iy z -ly i +- 

converges to log(l+y). 
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9. Some useful inequalities 

Consider the graph y — t ~ l , P the point (1,1) on it, and Q 





0 N R t 


the point (x, x~ l ) on it, where x > 1. Since t- 1 becomes steadily 
less as t increases, it is clear that 

rect. NQ < area PNRQ < rect. NT. 

That is, when x > 1, 


-<J! 


< X—l, 


jr J_ 

i.e. — -<\ogx<x— 1 (x > 1), 

or — jpj < log(l+x) < x (x > 0). 

In (1) put x — (1— 1) _1 , where 0 < £ < 1; we get 
£ < log ~ (0 < i < 1). 

The inequalities (2) and (3) enable us to show that 

lim(l + -Y l = e* 

ft— >-oo \ 71 J 

for all real values of x. For, if x > 0, then (2) gives 

x , / x\ x 

— — < logs M — I < — 5 
x-\-n \ 71 j n 

Si ■' ” Io s( 1+ ;) 


i.e. 


< x. 


(5) 
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Since -> x as n co, 

it follows that nlog(l+x[n) -> x as n -*oo, and so, by § 3, (4) 
follows when x > 0. 

When x is negative, equal to — f say, and we take n large 
enough to make (f/w) < 1, (3) gives 



i.e. on multiplying throughout by — n, 

* > nl °i 1 + l) > (6) 

which is (5) with the inequality signs reversed. 

We conclude with an 'inequality theorem 5 that has frequent 
and diverse applications. 

Theorem 40. If Jc is any fixed positive number , then 
e x 

-r-> oo asx-> oo, 
x K 


logo: 


x K 


-> 0 as # -> co . 


In the first place, if x is positive and M is an integer that 
exceeds k } say M— k — a > 0, 


e x > l+*+|j+-+ 


MV 


Hence 


gX rjQjSI. —k 

X* > ~mT 


X a 

Ml 


(a > 0). 


As x increases indefinitely, so does x a , and, M being fixed, the 
first part of the theorem follows. 

Next, if x > 1, then (1) gives 

0 < logo; < x—I < x, 
so that, if n is positive, and x > 1, 

n log x — log# 71 < x 11 . 

log x ^ x n 
x k nx k 5 


Hence 
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4. Prove that, when \x\ < 1, 

<!+*)■-- 

5. Prove that, when |x| < 1, 

(1— cc:)- 2 = l-f2;r + 3a; 2 -f 4z 3 -f-..., 

(l-x)~ s = l + 3x+6x *+ ... + J(n+l)(n-f 2)x n +.... 

6. Various identities can be obtained in a manner similar to the 
following: 

L !_ = 

1 —x 

Hence 

( 1 — ( T ^) a! + (^) kS — — + ( — + — Jc 1 +*4-^+-"} 

-*-fTVr," 1 K-+(-K , T 1 W- 

when [a; | < 1. Multiply the first two series: Theorem 27 gives, on 
equating coefficients, * 

■-(T)+fi) --+<->•(;) 

Note. See Theorem 47, which justifies the step of equating coefficients 
in two power series. 

7. Establish identities by considering 

( (T=^P = ( 1_a; )” _2 , <i+»«i+.>' = (i+x) m+i . 

8. When n is a positive integer, prove that 

= o, 

r = l 

and prove also that 

y { — l) r r m ( n \ — 0 when m = 1, 2,...,n— 1. 
r- 1 XrI 

9. If f(x) — JJ (x—a r ), a product of n different factors, and <j>(x) is of 
degree less than n, prove that 

4>i x ) \ <£%) 1 

f(x) Z,f'(a r ) x-a/ 

r=l 

and hence show that when \x\ is sufficiently small 
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and that when \x\ is sufficiently large 


4>(x) 

f(x) 


2 


A/'K) 

r= 1 


10. Show, by using partial fractions, that 
5a; 2 -16x-f 13 
(x-l)(x-2)(Zx-o) 


can be expanded in a series of ascending powers of x when \x\ < 1, and 
find the coefficient of x n in this expansion. 


11. Prove (i) that the series whose nth term is 


1 1 1 

n 2n-fl 2n-j-2 

is convergent, (ii) that its sum is f— log 2. 

12. Expand log(l-{-a: 3 ) and log(l — x+x 2 ) in powers of x. 

13. If n is a positive integer, expand log(l+^~ 1 ) as a power series in 
{l/(2n-j-l)}. 

14. Show that, if powers of x above the sixth can be neglected, 

(120 + 6Qa;-f I2x 2 +x z ) + (l2Q-Q0x+12x 2 ~x 3 ) 
is equal to e x . 


15. Multiply the expansions of (I— a;) -1 and log(l — x), and deduce by 
integration that 

£[log{l-*)] 2 = ^ 2 +i(l + J)a; 3 + J(l + J+|)a;4 + .... 

16. Determine the expansion of log(l+#).lo'g(l — x) either by direct 
multiplication, or by expanding the differential coefficient. 

17. Prove that, when x > 1, 

(l+x)-* = x-i— ^ x ~ i +Y2 x ~ i — ■■■■ 



CHAPTER XIII 
POWER SERIES 
1. Series of complex terms 

1 .1 . We assume that the reader is familiar with the complex 

number 2 = or, on writing x — r cos Q and y — r sin 0, 

z = r(cos 6+i sin 6); and that he is familiar with the representa- 
tion of complex numbers in an Argand diagram. 

Definition. A sequence of complex numbers 
= Zn+iy* (n= 1,2,...), 

is said to converge to z — x-\-iy, if x n -> x and y n -* y. 

Definition. A series of complex numbers 
J, u n , where u n = v u +iw n , 
is said to converge if the sequence (s n ) converges , where 
s n = %+%+.. .+w n . 

Thus a necessary and sufficient condition for the convergence 
of 2 u n is the convergence of each of the series 2 v n> 2^/i* 

Definition. If z = x+iy == r(cosd-i-isin&), then 
\z\ = r = +*J(x 2 +y 2 ) is called the modulus of z, 
and arg z = 0 is called the argument of z. 

1.2. We shall not go very fully into the theory of series of 
complex terms, f but we develop certain results w r hich are 
necessary in the theory of power series. 

Theorem 41. If u tl = v tl +iw ni so that 

l«J = \/(*4+w’»), 

and if 2 \ u n\ ^ convergent , then 2 u n is convergent . If J \u n \ is 
convergent , then 2 ^ is said to be absolutely convergent . 

For |vj = +V(^n) < \ u n\> an( i so, by Theorem 8 (the com- 
parison test), 2 \ v n I converges when ^ |aj converges. Similarly, 
2 N n | converges when 2 \ u n I converges. 

Hence, when 2 NJ * s convergent, both 2 v n an ^ 2 are 
convergent. 

t The topic is more fully treated in E. T. Copson’s book on Functions of a 
Complex Variable (Oxford University Press, 1935). 
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Theorem 42. If 2 u n is convergent , then \u n \ 0 as n -» co. 

Because \u n \-+Q it does not follow that 2 is convergent . 

If = r n +«0 B , and if 2 is convergent, then both 2 ? w 
and 2 w» are convergent. By Theorem 14, v n -> 0 and -» 0, 
so that juj -> 0. 

The series 2 (i+i) 

is not convergent; its nth term ->■ 0 as n -> oo. 

2, Power series 

2.1. We shall use a n to denote a number that depends on 
n but not on 2, and the power series we shall consider is 

f a n z n = a 0 -\-a 1 z+...+a n z n +... . (1) 

n = 0 

This series we shall usually denote by 2 a n z?l - 

The most important fact about such a series is that either 

(i) it converges for no value of 2 other than 2=0, 
or (ii) it converges for all values of 2, 

or (iii) there is a finite number R, dependent on the coefficients 
a n , such that 

2 K 2 "l and so > also, 2 a n z n 
is convergent w r hen |z[ < J?, and 

2 \a n zn \ is divergent when |z| > R. 

We first establish the theorem on which this fact depends. 

Theorem 43. If, for a given z Q , 2 a n z o i* s convergent , then 
2 a n z n is absolutely convergent when \z\ < |z 0 |. 

Since ]?a n z% is convergent, we have (by Theorem 42) 

\ a n z o \ 0 asn-+co. 

Hence 3 N . \a n z%\ < when n^N, 

and | a n z n \ < |~|z/z 0 | n when n > N. 

But 2 | z/z 0 1' 71 is convergent when |z/z 0 | < 1, and so (by Theorems 
8 and 13) 2 \ a n zU \ is convergent when \z\ < \z Q \. 
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2.2. Now suppose ^a n z n converges for at least one value 
of 2 other than z = 0, so that the alternative (i) of § 2. 1 is ruled 
out. Let the series converge when z = z 0 , and let | z 0 | = r 0 . 
Then, by Theorem 43, it converges when \z\ = r if r < r 0 . 

Now suppose, further, that 2 z 71 does not converge for all 

values of z, so that the alternative (ii) of § 2.1 is ruled out. 
Let the series be non-convergent when z — z v and let \z x \ = r v 
Then the numbers r such that 2 \ a n z7l \ is convergent -when 
\z\ = r must have a finite upper bound < r v Let this upper 
bound be R. 

This number R is, by definition of upper bound, the least 
number that is greater than or equal to each and every r for 
which 2 \ a n z?l l is convergent when \z\ = r. 

It may be that R is actually greater than every such r; it 
may be that R is itself a possible value of r. Thus, always, 
2 a n z n is absolutely convergent when \z\ < R, and, possibly, 
2 a n z n is absolutely convergent when \z\ = R. 

Finally, 2 a n %n cannot converge for any z whose modulus 
exceeds R. For, suppose it converges for a z whose modulus 
is R+oc, where a > 0; then, by Theorem 43, 2 \ a n zn \ i s con_ 
vergent whenever \z\ = R+\(x, so that R+^a is a possible 
value of the r, and R is not the upper bound of the r. 

We have thus proved that, corresponding to every power 
series, 2 a n zU > which converges for some non-zero value of z 
but not for all values of z, there is a number R such that 


2 \a n zn \ is convergent when \z\ < R, 

2 [ a n z n \ is divergent when [zj > R. 

This number R is called the radius of convergence of the 
power series. 

Whether or not 2 \ a 7 i zU \ converges when |z| = R depends 
entirely upon the character of the sequence (a n ). For example, 
both the series f i i 


n < 


converge when [z| < 1 and diverge when |zj > 1 (as is seen by 
Theorem 10, the ratio test). When |z| = 1, the first series 
converges, while the second diverges. 
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2.3. The radius of convergence is given by 
lim loj-** 

but we shall not go into the proof of this, as lim is outside the 
scope of our present treatment of convergence. 

In examples w T e confine our attention to power series (and 
these are by far the most common type) whose radii of con- 
vergence can be determined by other means, usually by the 
ratio tests. 


2.4. Theorem 44. The series obtained by differentiating or 
integrating a power series term by term have the same radius of 
convergence as the original series. 

If the original series converges for all z , so do the differentiated 
and integrated series. 

Let R be the radius of convergence of J a n zU - Let z be any 
complex number (not zero) whose modulus, r, is less than R. 
Choose z x so that r < \z x \ < R [say, for example, 

w = w+m 

Then 2 \ a n z i \ is convergent, so that \a n z x \ 0, and 


3 N . \a n Zi\ < l- when n > N. 


When n ^ N, 


I na n z 


■n-l [ — 


. \a„ v 


n “ 1 1 


< Yr 71 ^ 71 ' 


But the series n P n convergent when \p\ < 1, so that, 
since \z\ < |z 3 |, ^hiY 1 is convergent. Hence (by Theorems 
8 and 13) 2 | na n z u ~ x \ is convergent, and so 2 ^a n z n ~ 1 is abso- 
lutely convergent whenever \z\ < R. 

Similarly, ^ a n z n+1 /{n+l) is absolutely convergent when- 
ever \z\ < R. 

Now suppose that the radius of convergence of na tl z n ~ l is 
greater than R and equal to R v say. Then, on integrating this 
series, the series 2 a n %n is absolutely convergent when \z\ < R v 
But this is incompatible with the assumption that 2 \ a n zU \ 
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diverges when \z\ > R. Hence the radius of convergence of 
2 na u z n ~ Y cannot exceed R. 

Similarly, the radius of convergence of the integrated series 
cannot exceed R. 

This proves the theorem when the original series has a finite 
radius of convergence. If the original series converges for ah 
values of z we may, by the previous work, show that £ na u z 71 - 1 
and 2 a n z 7L+1 l(n J r l) converge absolutely when \z\ < A, where 
A is any number we choose. Hence these series also converge 
for all values of z. 

2.5. For our remaining theorems we shall confine ourselves 
to real values of z. 

Theorem 45. If the radius of convergence of 2 a n x n is R, 
then 2 a n* n uniformly convergent in {—R li R 1 ) > where Rj is 
any fixed positive number less than R. 

In special cases it may be uniformly convergent in ( — R, R): 
in general , it is not . 

Let R x be any fixed positive number less than R. Then 
2 convergent. But 

\ a n xU \ < \ a n R l\ when M < 

and the M test proves the theorem. 

In the special case when 2 \ a n R n \ is convergent, the M test 
proves uniform convergence in (—R,R). We have only to 
consider the series 2 xA to see that (— R,R ) is not, in general, 
an interval of uniform convergence; for then R = 1 and the 
series diverges when x = 1 . 

Corollary. If ^a n x n has a radius of convergence R, and 
if f(x) denotes the sum of the series when \x\ < R, then 

f'(x) = J, ^a n x n ~\ 

//«)<«= 2 °”s+ 1 
0 1 

whenever \x\ < R. 

Let x have any definite value whose modulus, r, is less than 
R. In Theorem 45 take R x = £(r+I?), so that \x\ < R x ; 
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2 a n x n and (by Theorem 44) 2 na n xll ~ l are uniformly conver- 
gent in ( — The two parts of the corollary follow by 

Theorems 33, 31 respectively. 


2.6. The result just given about integrating a power series 
term by term is all that we can obtain from a straightforward 
application of Theorem 31 to the general case. If the series 
^a n x n is one which is absolutely convergent when \x\ = R, 


X 

[ f{i) dt = 2 1 


when \x\ ^ R, 


since there is then uniform convergence in (— i£, R). 

But by far the most useful result about the integration of 
power series is contained in Theorem 46, which follows. Its 
proof uses most of the facts we have proved concerning power 


series. 


Theorem 46. If f(t) denotes the sum of the series 2 then 

t®*- 2 ' “*^Ti 

0 

'provided only that the latter series is convergent. 

We shall first prove that 





whenever the series on the right is convergent. 

If 2 bjin+l) is convergent, then, by Theorem 43, 

2 IM’Vfa+i)! 


converges when \x\ < 1. Hence, by Theorem 44, £ b n x n con- 
verges absolutely when \x\ < 1 and, by Theorem 45, it con- 
verges uniformly with respect to x in (0, S), where 8 is any fixed 
positive number less than 1. 

Let <f)(x) denote the sum of 2 b n x fl when \x\ < 1, and let 
8 be any number between 0 and 1. Then, on integrating a 
uniformly convergent series, 



yM B+ \ 

Zw n - fl 

71 — 0 


(1) 
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But, whether <j>{x) remains finite or does not remain finite as 

x->l, i 8 

J <f>(x) dx = lira J 6 {x) dx ( 2 ) 

o o 

as 8 -> 1 from values less than 1 . 

Also, by Theorem 29, whenever 2 K/( n ~r^) * s convergent 

we ha\ e » » go , . ■? 

V -*»_ = limV^L (3) 

Z, n+1 Z, rc+1 v ; 

as S -> 1 from values less than 1 . 

By (1), the R.H.S. of (2) = the R.H.S. of (3) for every 
positive 8 < 1. Hence they have the same limit as S -> 1, and 


j ( \ b - x ") 

J ' 71 = 0 7 


dx 


00 

yA. 

Z- 71+1 


71 = 0 


whenever the latter series is convergent. 

Now” put b n — a n oc n+1 and, in the integral, x = tj a; w”e get 


5 bi = 0 7 n = 0 1 

provided only that the latter series is convergent. The theorem 
follows on simplifying the L.H.S. of the last equation. 

2.7. We conclude with a theorem which justifies the device 
usually known as 'equating coefficients’. 


Theorem 47. If one and the same function f(x) can be ex- 
panded in a power series in two distinct ways , so that 

f{x) = 2 a n x n = f 

71 = 0 71 = 0 

both series being convergent when \x\ < R, then a n ~ b n for all 
values of n. 


If we write a n —b n = c n , then, wdien \x\ < R, 

0=2 c n x n , (1) 

71 = 0 

and our theorem is equivalent to saying that a power series 
cannot represent zero unless all its coefficients are zero. 

Let R 1 be any positive number less than R. Then, by 
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Theorem 45, 2 c n x7t is uniformly convergent in (~R V Rj) and 
so, by Theorem 32, its sum is a continuous function of x in 
(—R v i?i). Hence, if <f>(x) denotes its sum, 

Cq = (f)(0) — lim — lim 0 = 0 . 

x—r® x~^0 

Henc-e c 0 is zero; when r^Owe have, on dividing (1) by x, 
0=f c n xn ~ 1 (j*| < R, x ~ 0). (2) 

71 = 1 

If \fj(x) denotes 2 o n x n ’~ 1 i the previous argument gives 
c 1 = \fj( 0) = lim ifj(x). 

a :— >0 

But, by (2), ip(x) — 0 when x ^ 0, and therefore the limit of 
iff(x) as x tends to zero is also 0. Hence c x = 0, and so on for 
the coefficients c 2 , c 3 ,...,c n ,... . 


3. The behaviour of a power series on its circle of con- 
vergence 

In all the preceding discussion we have considered the 
question of convergence for points z that lie on the circle 
of convergence, \z\ = R , only in the very easy case wffien 
2 \ a n\B n convergent. Then, of course, 2 a n z?l convergent 
wffien \z\~R. 

If 2 \ a n\R n is not convergent, then almost anything may 
happen to the series 2 a n zU when \z\ = R. There are series 
that converge, but not absolutely, for all z whose modulus is 
R; there are series that do not converge at all. As an example 
of the latter take 2 s u * Its sum to n terms when z = cos O+i sin 6 
is given by 

1+Z+. = (I — z n )f(l — z) 

1 — cosnd—isinnO 

1— cos 8—i sin 8 


sin in6 ( n—l n , . . n— 1 
sin \8 \ 2 ^ 2 


and, 8 being fixed, this does not tend to a definite limit as n 
tends to infinity. 

Again, there are series that converge at all points save one 
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of their circle of convergence, some at all points save two, and 
so on. For example 


% 2 

1+Z +2+- + W- 


has \z\ = 1 for its circle of convergence. It does not converge 
when 2=1. But, when 2 = cos Q-\-i sin 9 and 0 < 8 < 2tt, 
each of the series 


2 


cos nd 

j 

n 


2 


sin nd 
n 


is convergent (Chap. IX, §3.5). That is, the series 2 zU \ n 
converges at all points save one of its circle of convergence. 


Examples XVIII 


1. If X °n is convergent, then '£a n x n is uniformly convergent in 
(0, 1) (Examples XVI, 7), and if X ( — l) w a n is convergent, then X <x n x n 
is uniformly convergent in ( — 1,0). 

2. If fix) = X a n^ n when |a;| < R lt and if g(x) — X b n x n when 
\x\ < R 2 > then f(x)g(x) = X c n^ n > where 

c n = « 0 & n+ a i & n-i-f ... + a n 6 0 , When \x\ < R x , R 2 . 

3. Differentiate j 1 +x+ + ♦«• + J ^ ' ZY) li erX 

and hence prove that its expansion is 


1- 


fl 


+ 7 


(n— l)!ln n + 1 1 2!(n+2) 




4. Determine the radius of convergence of each of the series 


2>~ 


2 


n+ 1 


(n-f-2)(ft-f 3) 


X n 2 z n , 


2 


nz n 

(M-l)® 


and find the sum of each series. (The ratio tests for absolute convergence 
give unity as radius of convergence.) Show that the second and fourth 
series converge when z — — 1. 


5. Prove that 


i 1 a - b 

1+ T7c z - 


a(a+ 1)6(6+1) , 
1.2.c(c+l) Z "' r ‘" 


has unit radius of convergence. 


6. If F(a,b;c;z) denotes the sum of the series in Example 5, prove 
that 


(i) %-F(a,b;c;z) = — -F(a+ 1,6+1 ;c+l;z); 

az c 

(i i) jP(a, 6;c;z) = (1— z) c ~ a ~ b F{c~~ b,c — a;c;z). 
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7. By considering the coefficient of x n ~ x in the expansion of 
(1 — x — a: 2 )” 1 , prove that 

l-r(a-2 } ^ sT j, 

where a, /? are the roots of the equation u 2 —u—l = 0. 

8. Prove that if (a 0 -f = 2 Vn xn when \x\ is suffi- 
ciently small, then 

aQPn J r a i 2 >n-i + -+a k p n ^ lc = 0 (n > 1) 
provided that p_ 2 ,... are interpreted to be zero. 

9. Prove that each of the series 

1 2x 3 2.5.8.x 6 

— 1 ~r 2 ~^ ‘2 3 5 6 ‘ 


x+- 


4x 4 4.7.10.x 7 


"h 


3.4 1 3. 4. 6. 7 

is convergent when |4x 3 | <1. If y denotes the sum of either series, then 

^->>3+ 6 4^=°- 


10. (Harder.) By considering the expansion of 

x m (x+ l) m (2x-f l)-x m (x- l) m (2x- 1) 
in powers of x, determine s 2 and s 4 when s r = l rj r 2 rj r ... j r 7i r y and show 
that s 2m , where m is a positive integer, is equal to n(n~\- l)(2n4- 1) 
multiplied by a polynomial in n(n- j-1). 

11. Prove that the series 


lx 3 , lx 5 , 1 . 3 x 7 

2 y + 2T4 5 t 2.4.6T + "' 

is convergent (i) when 0 < x < 1, (ii) when x = 1. 
Find, in each case, the sum of the series, 

12. Prove that the series 


x 2 2! 3! 


converges if |x| < e. 

13. Show that 

1 - i + l~i + A - -*^ + i^ log(1+V2) - 

14. Prove that the radius of convergence of the series 

1 , 1.3 2 , 1.3.5 3 , 

2 X +2~5 X ^2~5~S X + 


15. Prove that the series l J r A 1 z+A 2 z z i-... ) where 
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and \q\ < 1, converges for all values of 2 . If F(z) is the sum of the 
series, prove that F(z) — (l-qz)F(qz). 

Find the value of B n if 

{FWs- 1 = l + B lZ +... + B n z« + ... 

and prove that this series converges when \zq\ < 1. 

16. Prove that, if F{a,b;c;z) is the sum of series in Example 5, then 

(FF d W 

z(l- z )j-z +{c-( a + b + l)z}— -dbF = 0, 

F(a,b;c;z)-F(a,b;c-l;z) = — ~r ^rr i ?, (a+ 1,6+ 2 ;c+i; a). 

C{C — X) 



CHAPTER XIV 
THE INTEGRAL TEST 

1 . The integral test for series of positive terms 

1.1. Theorem 48. If f(x) > 0 when x > 0, and if f(x) 
decreases as x increases , then the sequences 

s n =/(^)+/(2)+**.+/(^) (w = 1,2,...), 

4 = jf(z)dz (» = 1,2,...) 

1 

are eitfAer convergent or both divergent. 

Since f(x) > 0 when # > 0, the sequence (s n ) is monotonic 
increasing and the sequence (I n ) is monotonic increasing. 



Let P, Q be points on the graph y — f(x) such that x = n, 
n+ 1 respectively. Then, from the graph, 

rect. NRQS < area NRQP < rect. NRTP. 

Hence, since NR = 1, NP = f(n), RQ = f{n+ 1), 

71 + 1 

/(»+ 1) < J /(*) </+)• (1) 

71 

If we write down (1) with the special values n = 1, 2 ,..., n— 1, 
and add, we have 

«»—/(!) < 4 < *»—/(»)• ( 2 ) 

Now suppose that I n -»■ a finite limit I as n->oo. Since (/„) 
is m.i., we have I„ < J, and so, from (2), 

«» < 4+/U) < W(i). 


(3) 
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But I+f{ 1) is independent of n, so that, by (3), (s n ) is a m.i. 
sequence whose upper bound < I+f(l). Hence s n -> a finite 
limit, s say, such that s < I+f( 1). 

Similarly, if s n -> a finite limit s, (2) gives 

L < s n~f( n ) <s n <s 

and /„ -*■ / ^ s. 

if 4 ->cc, then, since > 4+/(ra), ->oo; and if s n ->co, 

then, since I n > /(l), I n -> 02 • 

Notes. 1. A better proof of the last two lines is ‘A m.i. sequence 
must converge or diverge: the convergence of either one of (s n )> (I n ) 
implies the convergence of the other; hence the divergence of either 
implies the divergence of the other’. 

But not every one finds it easy to follow. 

2. For readers whose knowledge of integral calculus is sufficiently 
advanced, (1) may be proved without any appeal to graphical considera- 
tions thus: 

When n < x < n+1, f(n) > f(x) >/(n-f 1), and 

71 4- 1 Tl + l 7t-rl 

I /(n) dx > J fix) dx > J f(n+l)dx, 

n n n 

n + X 

i*e. f(n) > J f{x) dx >/(n+l). 

n 

The = sign covers the case when f(x) remains constant from x — n to 
x = n+1- 


Corollary. 2 n ~ p convergent if p > 1, divergent if p < 1. 
For, when /(?i) = 


n 



1 


according as p 1 or p — 


n x ~~ v — 


1 . 


1 


or log n, 


1.2. There are numerous occasions when the comparison 
of a series with an integral is a useful step. Especially is this 
the case when the integral can be evaluated. 

If f(x) decreases as x increases we have, from (1), 


f(n+l)+...+f(n+k) 

n+k n+k — 1 

< J f(x) dx <f(n)+...+f(n+k— 1) < J f(x) dx. 

n n - 1 
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For example, when n and k are integers, 


iog (i + ^) < 


n(n+k) < n i ' (n+l)*~ r '"~ T (n+k-1) 2 " (n-l)(n-l+]c)’ 


< 


n—lj’ 

k 


l , 1 , , 1 

n--\- 1 ' (n-f-l)Hl (w+fc-l) 2 +l 

< tan _1 f — — — 

\(n— l) 2 +k(n— 1)+1 

If we keep n fixed and let k ->cc, we see from the second of 
these examples that 

n 2 (ti+1) 2 

lies between Ijn and l/(n— 1). 


2. Euler’s constant 


Theorem 49. Iff{x) > 0 when x > 0, and iff(x) decreases as 
x increases , then 

f(l)+m+...+f(n)~ jf(x) dx (4) 

1 

tends to a finite limit as ?i ->oo. 

Write <f) n to represent (4). Then, by (2), 


<f> n s n I n 3> f(n) r> 0. 


Further, 


$n + 1 $n ~ ( s n+l~~ s n) 

n+X 

= /(«+!)— J f(x)dx 


< o, 

by (1). Hence 

4i >4 2 >h> - > 4n > - > 0 ; 

that is, cf> n is a m.d. sequence whose lower bound > 0. 
<f> n -> a finite limit. 


( 6 ) 

Hence 
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Corollary. In particular 
1 

'2 


1 - 


•••+: 


n 


n 

/ 


dx 

3 

X 


that is, 


log'll, 


1 + 1 + 

fenrfs to a finite limit C, called Euler's constant. 

The constant C (or, in an equally common notation, y) is of 
frequent occurrence in analysis. The corollary itself expresses 
precisely what is often useful in the less precise form 

i s about as big as \ogn\ 

2 n 


Examples XIX 


1. Examples XIV, 1-6. 

00 

2. Prove by the integral test that the series X 1 jn(\ogn) v is con- 

71 = 2 

vergent if p > 1, divergent if p < 1. (Compare Theorem 17.) 

3. Prove that if p > 1 the sum of the infinite series l~ p -{-2 ~ p is 
less than p/(p— 1). 

4. (Harder,) Prove that the series whose nth term is 


is convergent, and that the sum of p terms of this series after the nth 
lies between 

1 - P - and 1 £ (i-lfe+ !+P ). 

2 n(n-fp) 2 (n-pl)(n-j-l-fjp) \ 3 n 2 -j-np / 

[When x > 0, $x 2 — $x 2 < x— log(l-f:c) < £z 2 .] 

5. Find the limits as n — > co of 

JL+JL.+JL _J 

n+1 n+2~ ' 2n* n- j-1 n + 2^ 2n 

6. If x is real, show that 




3 5 7 




converges when \x\ < 1 but not otherwise. Show that its sum is 
( tan" l x ) ( tanh" 1 # ) . 

7, Prove that, when 0 > p > —1, 

n p+1 

lP + 2 *+...+n*- — 

P + 1 

tends to a finite limit as n —> go, and hence that 

{(lP + 2 p +,..+n p )/n p + 1 }-+ 1/ip+l). 



CHAPTER XV 
THE ORDER NOTATION 


1 . Gauss’s ratio test 

1.1. If 2 u n a series of positive terms, and if the ratio 
( u J u n- j-i) tends to a limit other than unity, then Theorem 10 
decides at once whether the series is convergent or divergent. 
For a large number of series whose terms are such that (u n /u n+1 ) 
tends to unity, the following theorem will decide whether the 
series is convergent or divergent. 


Theorem 50. If u n is real , and if the ratio (u n /u n+1 ) can , 
when n ^ some fixed N, be expressed in the form 


^ n i | t* i 


( 1 ) 


where |A J < a fixed number K> and A > 0, then 2 u n con ~ 
vergent when fi > 1, divergent when /x ^ 1. 


We see at once that u n 
that 


i 




'n+1 


is eventually of constant sign and 
l] -> /x as n -> co, 


and so (Theorem 11) the series converges when /x > 1 and 
diverges w T hen /x < 1 . 

When /x = 1 we apply Theorem 12 with D n = nlogn) by 
Theorem 17, AT 1 * s then divergent. When fx = l and 
D n = nlogn, 

D n~~D n+ 1 = »log»f l + l + ^)-(»+l)log(n+l) 

u n + 1 \ n n ) 

Rut, by Theorem 40, n~^ log n 0 when A > 0, and so, since 
| A n \ remains less than a fixed K , A n n~ x \og n -» 0 when A > 0. 
Also (by Chap. XII, §9(2)) 
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so that (72,+ 1 )log( 1 -j- -> 1. Hence 


D n 


u n 


^n-ri 


-R 


n + 1 ' 


and ^ * s divergent when ^ = 1. 

1.2. In many examples it is not difficult to see that the 
ratio (uju n+1 ) can be expressed in the form (1). Consider the 


series 


Here 


1 

x 

u 

u n 


2 ! 


3! 


x(x+l) x(x+l)(x+2) 


(2) 


x+n 

Ti+1 


= 1 - 


71+1 
X— 1 


x—l 


and if we write 


x— 1 


71(71+ 1 ) 


n 

±n 

n 2 


71(71+ 1 ) 


then \A n \ < |rr — 1 1 . Hence if x is fixed, the ratio (uju n+1 ) can 
be expressed in the form (1) with /z = x— 1, and the series (2) 
converges when x— 1 > 1, diverges when x— 1 < 1. 

1.3. The test contained in Theorem 50 becomes more power- 
ful when it is combined with the technique of using the order 
notation, which we shall now explain. 


2. The order notation 


2.1. Let f(7i) be a given function of n, a variable positive 
integer. If the sequence {f(7i)/7i r } is bounded, that is, if there 
is a number K such that 


f(n) 

n r 


<K 


or, what is the same, 


\f(n)\ < Kn r 


(3) 


for all 71 , we write f(7i) = 0(n r ). If (3) holds when r = 0, that 
is, if the sequence {f(n)} is bounded, we write f(n) = 0(1). 


Examples. 


(i) (7i+2) 2 = 0(72+. 

For W - 

To 


4 4 

!+- + --► 1 
71 71 - 


as 7i 00 . 
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By Theorem. 1, a convergent sequence is bounded, and so the 
sequence {{n+2) 2 /n 2 } is bounded. 

(ii) = 0{n~%). 


For 


(hi) 


3?i— 4 
7i-\- 3 


J{n a +n) 


Jn 3 


\n 




= 0 ( 1 ). 


3^2, 4 

For the sequence — -> 3 and so, by Theorem 1, is bounded. 

n-\~o 


2.2. Sometimes the function f(n) is comparable to some func- 
tion other than a power of n. For example, the notations 
f(n) = 0(e 2n ), f(n) = 0{nlog2n) 
mean respectively that 


f(n) 


f(n) 


(n = 1, 2,...) 


e 2n n log 2 n 

are bounded sequences. 

Sometimes, too, n must be restricted if the relation implied 
by the 0 symbol is to be true. Thus 


— = of-) when n ^ 2. 
n—1 \nj 


For 


1 . 1 _ n 

n—1 ' n n — 1 9 


which takes the values 2, § ,... when n = 2, 3, and each of these 
values < 2: but we cannot admit the value n = 1. 

Similarly, 

~ °(g) 

and, more generally, 


; 0(n p - q ) when n ^ N } 


b Q n^+b 1 n^+^+b q 
where N is greater than every real root of the equation 


bo% q +.-.+b q = 0. 

2.3. When one is thoroughly practised in the use of the O notation, 
it is convenient to modify it. Usually, one is not interested in the 
behaviour of f(n) save when n — > oo, and the limitations n > 1, n > N 
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are merely irksome details without real relevance to the problem in 
hand. The common practice is to write 

f{n) = 0(n-») 

to mean that ‘if we fix n Q suitably, there is a constant K such that 
|/(n)| < Knr 2 when n > n 0 \ 

This practice is recommended to the reader only after he has worked 
for some time with the notation in which the limitations n > 1, n > \a\> 
etc., are taken into account. 

3. The limit notation 

In much the same way the notations 

f(n) = 0 (n), f(n) — o(n~ 3 ) 
denote respectively the facts that 

-> 0, n s f(n) 0 as % oo, 

7h 

while the notation f(ri) = o(l) 

denotes that f(n) -» 0 as n -+ oo. 

4. Applications of the order notation 
4.1. Theorem 51. If , for » > 1, 

f(n) = “o+J+J 2 +-, 

where the as are independent of n and the series is absolutely con- 
vergent when n=l, then 

f(n) = «o+0^), 

f{n) — a 0 + - 7 + c/— V 
n \n*J 

and so on. 

By hypothesis, 2 |a r | is convergent, and so the series 

Oil + OC 2 X-{-OC 3 X 2 +... 

converges uniformly in \x\ < 1. Hence its sum is a con- 
tinuous function of £ in \x\ ^ 1. In particular, its sum -> 
as x -» 0. Hence the sequence 

n{f(n)-cc 0 } (7i= 1,2,3,...) 
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tends to the finite limit a x as n co. Accordingly, this sequence 
is bounded and there is a K such that 

n\f(n)—cx Q | < K , 

i.e. /(»)—' “o = °|~j- 

In order to prove that 

= °(s) 

we repeat the same argument, beginning now with the series 

Q^2 + a 3 a: +*-* * 

Corollary. If f(n) = a 0 +a 1 ^~ 1 +a 2 ^~ 2 +... is absolutely 
convergent only when n ^ some fixed N , then 

f(n) = -ao+O^- 1 ), /(ft) — oL 0 +oL 1 n- 1 + 0(n~ 2 ) whenn ^ N, 

and so on. 

In this case the sequence 

n{f(n)-ct Q } (n = N,N+l,...) 

is bounded. 

Examples. 

® ( i+ iy = 2 . 

(») (‘ +;)* = 1 +^+ °(;>) " ,|ie " ” > N > l«l. 

(iii) log(l + i) = i + o(I) when w > 2, 

(iv) e*=l + ? + o(i). 

In (i) our method gives the result when ft ^ 2 and not when 
ft ^ 1 because, unless jfc-f- 1 > 0, the binomial series does not 
converge when n = 1. 

4.2, Theorem 52. // a, 6 are fixed, and if 
f(n) = 1 + ^+ ^(») = 1 +~ + when n^N, 

then f(n)<f>{n) = 1 when n ^ N. 

ft \ft7 
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By hypothesis, when n > N , 

/(n)=l + ^ + |f, fl»)=l+£+|s, 

where |AJ < K x and \B n \ < JST,. Hence 

/W * W -l-?±5 - s{«‘+^.(l+;)+il.(l+ ;)}■ 

Moreover, the sequences 


i+-, i+2 

n n 


(n = N,N+ 1,...) 


are convergent and so there are constants, K z and say, such 
that 

< (w > N). 


i+2 

<K „ 

1+- 

n 

1 

n 


Hence, when n ^ N, 


mm- 1- 


a-\-b 


n 


+K l K»+K t KJ, 


TV 


and the latter is a constant multiple of (Ijn 2 ). 
4.3. The result of Theorem 52 may be written 


{ 1+ I+°(ji)){ 1+ s +0 (^)} 


(n > N) 


- i+? ?+ o (s) <«»*>• 

It includes as a special case (A n = 0 in § 4.2) 

( ! +;){ 1 +;+°(s)} <»>*> 

“ 1 + ? ?+ 0 (l) <»>">• 

4.4. Applications to Theorem 50. 

(i) The series 

!+_*!_+ *1 +... 

a; ‘ x(x+ 1 ) ^ x{x + 1 )(x+ 2) 
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is convergent when x—1 > 1, divergent when x—l < 1. 


u n _ n+x = 




'n+i 


7i“p 1 


= 1- 


71 


1+ ;)l I - 


jht 


+ o &) 


(n > 2) 


and Theorem 50 proves the result. 

Or the w r ork may be set out as in § 1.2. 

'V~ A / 2.4: 2 71 \ “ 

(ii) The series ^ f - J * s divergent. 


u, 


'n-hl 


{2n+3y 

\2n+2] 


= j 1 + 


2n 


1 + n 


1 +- + 0 , 

n 


71 * 


1 ~ + o(\ 

n \n 2 


(n ^ 


= l+i + o(l), 

n \n 2 ] 

and the divergence of 2 u n * s proved by Theorem 50. 
Or, on the lines of § 1.2, 

2 ” +3 H^r- 1 • 1 


\2n+2 
and, if we w T rite this as 


n+l 1 4(7i+l) 2 ’ 


then 


A 

n 2 


+ n + n 2 ’ 
1 1 . 


1 


n+l n ‘ 4(n+l) 2 
1 1 


4(n+l) 2 n(n+ 1)’ 

and the divergence of J u n is proved by Theorem 50. 
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5. Series of complex terms 
Let u n = v n +iw n , and let 


Un _ 1 . , A+jg n 

u n+1 n n 2 ’ 

where |.4 B |, \B n \ are bounded for all some fixed N. 
If we recall the fact that, when z — x-\-iy, 

| 2 |2 = (z+iy)(x—iy), 


( 1 ) 


we see that (1) gives (on using Theorem 52 extended to com- 
plexf a, b) 



■ «+ff 

‘ n 





= 1+^+0 
n 



and so, by the binomial expansion for (1+a;)*, 




u. 


'n+1 


n \n 2 ] 


(2) 


Hence if the terms of a series u n are such that (1) holds, 
then the series is absolutely convergent when a > 1; that is, 
for absolute convergence, the real part of ot+if3 must exceed 
unity. 


Examples XX 


1. Prove that, when b is neither zero nor a negative integer, 

a o(a+ 1) 

6(6 + 1 ) 

is absolutely convergent if 6— a > 1. 

2. Prove that the hypergeometric series 

1+ ±i x+ ^±im±j) x , + ". 

1+ l.y + 1.2.y(y+l) 

has unit radius of convergence and converges absolutely when \x\ = 1 if 
(i) y > 0 L+fi> or (ii), assuming a, f$, y to be complex, if the real part of 
y— a— jS is positive. 


f The only new fact wanted is ‘if a n = is a sequence that converges 

to a finite limit a -Hj3, then |a n | is bounded’. This follows at once from Theorem 
1: for a n -*a, and so |c^|, \f} n \ are bounded. Hence \a n \ — V( a n+^) is 

bounded. 
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3. Prove that, when a and h are positive, 

a a(2a+l) , a(2a+ l)(3a+ 1) L 
6 ' 6(26+1) ' 6(26+l)(36+l) + " 
is convergent if and only if b > a (Theorem 10). 

4. Prove that the infinite series 


1 +)■■+ I^T + 1 " 1 **- af ' - T ■ + - 


is absolutely convergent if the real part of /x > —\ 

5. The sequence ( a n ) is such that 


^±1 = an + 6-rO(-). 
a n \nJ 


Prove that the series 

x(x-\-\)...{x J r n) 

is absolutely convergent when \a\ < 1 and also when a = 1 provided 
that x > 6. 

In the following examples use the 0 notation as explained in § 2.3. 

6. Prove that, when A > 0, 

i+ ^ + °ty = ( i+ 3( i+ °ty I* 

and hence that 


where (i > 0. 

7. Prove that, when A > 0, 


p fi +0 fcy) = 1+ I +0 fcW ’ 


where v > 0. 

8. Use Example 6, part (i), to prove that 

( i+ i + °ty) =i+ ^+°(^w)’ 


where 8 > 0. 



CHAPTER XVI 
TANNERY’S THEOREM 
1. Tannery’s theorem 

1.1. We first prove what is usually known as Tannery’s 
theorem in a form that differs from the original form given by 
Tannery himself. The new form accentuates the relation of the 
theorem to the idea of uniform convergence. 

Theorem 53. Let m 

F(x) = 2 v n (x), 

n—1 

the series being uniformly convergent with regard to xfor all positive 
x. Further, for each fixed n, let 

v n (x ) ->w n as x -> co. 

Then the series 2 w n is convergent and 

00 

F(x) 2 w n asx-> oo. 

71 = 1 

(i) We first prove that w n converges. 

By the uniform convergence of £ v n (x) for all positive x, 
e, k > 0; 3 N . for all positive x 

1^2 v n (x)^ < ek when p — 1 , 2 ,.... 

As a;-»co, % +1 (z)+...-f-% +i) (a:) Wn+i~\~----\-Wn+p- Hence 

u>„| < ek whenp = 1 , 2 ,.... 

On taking k = £, we see that 

liV-f# ! 

e > 0; 3 J . j wJ < e whenp = 1 , 2 ,..., 

* iV -hi I 

which is the condition that 2 w n should converge. 

(ii) The convergence of 2 w n having been established, we 
make a fresh start. Let W = 2 w n - Then, since 2 v n (x) con- 
verges uniformly to its sum F{x) for all positive x, and since 
2 w n converges to the sum W, 

e, k > 0; IN. F(x)— 2 v n (x) < ek for all positive x, 

n—1 
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N 

and W— 2 w n < 

71 = 1 

Hence, for all positive x, 

\F{x)—W\ < \F{x)~ | v n (x)\+ | *,(*)- | +1 f w n - IF 

i 71 = 1 I 71=1 71= 1 71 = 1 

< 2 e&+ 2 »»(*)— 2 «J. 

71 = 1 71 = 1 I 

But as x -> oo, each t; n (£) -> and so, since N is finite, 

N N 

2 «»(*) -> 2 «v 

71 = 1 71 = 1 

| N N 

Hence 3 I . j w n (a;)— < efc when x > X. 

171=1 71=1 

Finally, then, we have \F(x)-~ W\ < 3 ek when x > X. Hence, 

on taking h = J, we have proved that 

€ > 0; 3 X . |.F(a;)— TF| < e when x > X, 

which is the condition that F(x) -> W as £ — > go. 

Note. The result is unaltered if there is uniform convergence, 
not for all positive x , but only for # ^ X v a fixed constant. 

1.2. There is a particular case of Theorem 53 corresponding 
to each of the tests for uniform convergence established in 
Chapter XI, § 5. We shall enunciate two such particular cases. 

Theorem 54. Let 

F{x) = 2 r n (x), 

71 = 1 

aw? let ^ -3f n 6e a convergent series of positive constants such that 
\v n (x)\ ^ for all positive x. Further , /or each fixed n, let 

v n (x)->w n as x~>co. 

Then the series 2 w n ^ convergent and 

00 

F(a:) -> 2 as x~> ca. 

71 = 1 

By an easy extension of Theorem 35, since 2 is con- 
vergent and \v n (x) | < M n for all positive x, the series 2 v n( x ) 
is uniformly convergent for all positive x. 
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Theorem 55. Let «, 

F(x) = 2 a n v n {x), 

n = 1 

where 2 a convergent series of constants. Let v n (x) he mono- 
ionic decreasing {increasing) for each fixed x that is positive and 
lei \v n {x)\ < K for all n and for all positive x. Further, for each 

fixed n } let v n (x) 1 as x oo. 

Then F{x) 2 a n as x oo. 

By an easy extension of Theorem 37, 2 a n v n( x ) ^ uniformly 
convergent for all positive x. Further, a n v n {x) -> a n as x hmx>, 
and so, by Theorem 53, F{ x) -> 2 a n - 

1.3. Tannery’s original theorem is a particular case of 
Theorem 54. If v n (x) has zero values when n > k{x) we have 
the following result. 

Theorem 56. Tannery’s theorem. Let 

Mx) 

F(x) = 2 v n {x), 

n = 1 

where 

(i) k{x) -> oo as x -> oo, 

(ii) |v n (rc)| < /or all x, where M n is independent of x, 
and 2 M n is convergent , 

(iii) /or each fixed n , r n (#) -> as x-> oo. 

Then F{x) -> 2 as x ->co. 

There is a corresponding particular case of Theorem 55 in 
which the value of r n (x) is zero when exceeds &(#). 

2. Examples of Tannery’s theorem 

(i) ^1 + ij as n oo. 

If we write F{n) = {1-f (l/w)} n , then, ?i being a positive 
integer, the elementary form of the binomial theorem gives 

F{n) = l-\-n. --j- n -4 + **- f° w+1 terms 

72 , 2 ! n 2 

= 1 +l+i( 1 -i) + i(l-i)(l-|) + - to n+1 terms. 
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Then, for each fixed r ^ 2, 


Mn)\ < I for all n 
r! 


as n ->■ oo . 


Moreover, £ (1/r!) is convergent. Hence, by Theorem 56, 

*W-l+l+^+i+...+I + .... 

(ii) If x -» co, not necessarily through integer values, 

( X +l) -+ e - 


The binomial theorem for any index shows that 


whenever x > 1. But, when x is positive, 

\v n (x)\ = 1 


\z(x+l)...(x+n—l) 1 


If we write u n to denote this last expression, then 

14 -n 

u n + 1 x-\-n l-j-n/x' 

When x > 2 Un , \n 


^ __ 1 jn 

n + 1 l+lw 


and when w ^ 2 the last expression is 

Hence « 3 < §w 2 , m 4 ^ (|) 2 m 2 , and so on. Also, when x i> 2 ■ 

Hence < (|)»-3 when w ^ 2j so that 

l v »(^)l < (f) 71 " 3 when n > 2 and a: ^ 2. 
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It is now a fairly straightforward application of Theorem 54 
to show that {1 + (1 /x)} x -> e as x co. 

Examples XXI 


1. Prove that, when a is a real number, 

/ n 


(i) (l + -) 

as n — > oo. 



(“) ( L +d -*«“ 

as x — > co. 

2. Show that 



, 1,1, ,l l 

F(n) = ^+I + ^f2 + - + 2^ > 2 

and hence that F(n) cannot tend to zero as n oo, although (n-f-r)- 1 0 

for each fixed r as n oo. 

3. Theorem 54. Prove that 


OO 1 00 1 

n 2 +n 4 /# 2 2 n 2 


as x — > co. 

v-f -n*jx* Zw n* 

n=l n= 1 

4. Theorem 55 (with x — > 1 + 0 instead of £ — > oo). 

^ ( — 1 )»-%-* -> log 2 as#->l-{-0. 

71= 1 

5. Theorem 55 (with some v n (x) zero). Prove that, as k co, 

1 2 1 

a 1 + — a 2 +~ lr a 3 + ... + ^a Jc 

tends to 2 a n whenever the latter series is convergent. 

Hence prove that 

Si-f «o + ...+5 fl 

— — > s whenever s n — > s. 


6. Theorem 55 (with some v n (x) zero). The limit as n -> co of 

(n!) 2 a r 

. “ iJ (n-i 

r= 1 


71 

2 <-»' 


(n— r)! (n+r)! re— r 
is given by the sum of the infinite series 


whenever the latter series is convergent. 



CHAPTER, XVII 

DOUBLE SERIES 


1. Double series 

1.1. Consider the doubly infinite array 


a ll 

a 12 ■ 

a in 

• 

, a 21 

a 2 2 

a 2 n 

• 

a ml 

a Jn 2 

• • ®rnn 

* • 


Suppose that, for each fixed m, the infinite series formed by the 
terms in the with row, that is, 


a ml + a ™2+--*+ a mn+-**’ 

has a finite sum, R m say. Suppose further that the infinite 


series 




has a finite sum, R say. Then R is called the sum by rows of 
the double series 2 2 a mn- 

Similarly, if, for each fixed n (i.e. each column), 

a ln+ a 2n+--* + a mn + ... 

has a finite sum C ni and if 

C = C , 1 +<7 2 +C f 3+...+C f n H (-•••? 
then C is called the sum by columns. 


1.2. Let S mn denote the sum of all terms that are to be 
found in the rectangle formed by the common part of the first 
m rows and the first n columns. If there is a number S such that 


e > 0; 3 N . | S —S,nn I < € when m,n ^ N, 
then S is called the sum by rectangles , or simply the sum, of 
the double series. 


1.3. Double limits. When we consider a doubly infinite 
set of numbers 

0* = M*— ; v = 1,2,...), 

it is fairly obvious from the definition of 'limit 5 that the two 

numbers (1 r ) 

lim lim a , lim lim a 

fX — >00 V— >00 ' v— >00 »co ^ ' 
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are not necessarily equal. It is easy to construct examples 
where the two numbers are equal and to construct examples 
where they are not equal. For example, if 


then, for each fixed v, 


__ ( v+ l)fr + l) 

/xv (y+2)(/x+2) 


lima 

jU—>oo n 


v+l 

v+2’ 


and so lim (lim a ) = lim = 1; 

iMroa'ii — >ao • v — ycc V — r- Zt 


V—+CQ K [L — >00 


v -\ -2 


and a similar calculation shows that 

i 

[A — >00 jl- f-2 


jA — >00 y v — >00 

On the other hand, if 


lim (lima } = lim = 1. 

//— >ao ' u— 4.00 ' it — >oo , 




p+v v(ji+l)’ 


then, for each fixed p, 

lima = 

V— >00 l^~Y I 

and, for each fixed v 3 lim a = 


ft->C30 


Hence lim (lim a == lim — = — 1, 

jU— >co V— >00 ' >C0 1 

and lim ( lim a J = lim = 1. 

V— >00 1 JLt— >00 ’ V— >00 V 

Going back to the sum by rows and the sum by columns of 
§ 1.1, we see that if ^ v 

8 ?v = 2 2, 

t* 

then lim = 2 -R m > 

v—>oo m = 1 

and so lim (lim<SL,} = % R m = R, 

/X— >00 y— >C0 ' 771 = 1 

the sum by rows. 

Similarly, lim(limtf) = J,C n = C, 
the sum by columns. 
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As we have seen by examples, C and B need not be equal. 

1 .4. We shall not attempt a discussion of the general theory 
of double series. All we do here is to state simple conditions 
which will ensure that the sum by rows is equal to the sum by 
columns. 

2. Double series of positive terms 
Theorem 57. If each a mn is positive or zero in the array 


a ll 

a l2 

. . a ln . . 

a 21 

°22 

a 2n 

a ml 

a m2 ■ ■ 

' • a mn 


and if there is a finite sum by rows , then there is a finite sum by 
columns and the two sums are equal. 

First step. We can arrange the terms of the array as terms in 
a single sequence in a number of different ways: for example, 
we can write a n ; then all terms the sum of whose suffixes is 3, 
namely a 21 and a 12 ; then terms a 3V # 22 , a iz each with suffixes 
whose sum is 4; and so on. Given any term in the array, we 
can assign to it a definite place in the single sequence. We write 

b\ = b 2 = #21 » ^3 ~ ^4 = ^3lJ*** 

CO 

and consider 

71=1 

Let R m = f a mn , R = f R m , 

n—1 m — 1 

a N = 6 1 +& 2 +-**+^iV* 

Whatever value we give N , we can find a corresponding M such 

-that B 1 +R 2 +...+B m will contain all the terms of a N and 

others besides. Thus for each N there is a corresponding M 

such that M 

< 2 < #• 

m — 1 

Hence £ b n is a convergent series and, if B is its sum, 

B<R. 


( 1 ) 
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Second step . Again, if A is any number less than R, then 
i(A-f R) < R, which is the sum of 2 J8». Hence there is (by 
Theorem 3) a suffix k such that 

iZi+Jig+.-.+i?* . > J(A+jK). (2) 

This number & having been fixed, there is (again by Theorem 3) 
a suffix n such that 

a ii+— +®m > *®i — 2&(-^ — A), 
a 2i+--*+^2?i > — A)* 


a kl+‘--+ a kn > Rk — ^iR—^)- 

But, the numbers k and n having been fixed, there is a number 
N such that 6 x +6 2 +...+6^ contains all the terms on the left 
of these inequalities and others besides. Hence, there is an 
N for which 

cr N > R 1 -\-R 2 -{~...’{-Ri c — i[R—X) 

> *(H+A)— *(-B— A), by (2). 

It follows that B, which is the upper bound of the sequence 
(<7 n ), exceeds |-(jB+A)— \{R— A), that is, A. Hence B exceeds 
any number less than R. Hence 

B ^ R. (3) 

From (1) and (3), B = R. 

Third step. We now prove that if B is finite, then the sum by 
columns, C, is finite and equal to B. 

Consider a 11 +a 21 +...+a nl +... . (4) 

The sum of the first n terms, where n is any given number, is 
less than a N if we choose N large enough; also, cr N < B. Hence 
series (4) has a finite sum, C x say. 

Similarly, each column has a finite sum. Let the sums be 

Let M be an arbitrary positive integer. Then, as in the 
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second step, there is, given any positive S, a number n such that 

a ll+-"+°nl > — ^2 M 

J5 

a l2+***+ a n2 > ^ 2 ~~^2M 

M 

a lM+-"+ a nM > 

The sum of all the terms on the left of these inequalities is less 
than B. Hence 

B > C 1 -f-C r 2 + 

Hence the infinite series 2 Cm has a sum which is less than 
J5(l+8) for every positive 8. That is, C < B. 

But we can repeat the argument of the first step to show that 
B < C. Hence JB = 0. 

Corollary. If each a mn in the array is positive, and if we 
know that b n has a finite sum B, then the array has a sum by rows 
and a sum by columns, each equal to B. 

By tho argument of the third step, we obtain B = C; and 
by the same argument applied to rows we obtain B = R. 
A convenient name for B is ‘the sum by diagonals’. 

3. Absolutely convergent double series 
Theorem 58. If the array 


an 

« *12 

• 

* 

* *1» 

a 21 

a 22 

• 

* 

a 2n 

a ml 

a m 2 

. 


* ^mn 


is such that the array got by replacing a rs by its absolute value , 
|a rs |, has a finite sum by rows , then the original array has a 
finite sum by rows R, a finite sum by columns C , and a finite 
sum by diagonals B ; moreover , R == C = B. 

Consider two arrays, of which the first consists of the positive 
terms of the given array, and zeros in the places of all the nega- 
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tive terms. This array will have a finite sum by rows, R' say. 
By Theorem 57, it has a finite sum by columns, C' say, and a 
finite sum by diagonals, B ' say. Moreover, again by Theorem 57, 

R' = C' = B'. 

Let the second array consist of the negative terms of the 
given array, but with the sign changed, and zeros in the 
places of all the positive terms. Then, with an obvious notation, 

R n = V = B" 

as before. 

It is easy to prove that R = R'~R", that C = C'—C", and 
that B = B'-B". 

Corollary. The result of Theorem 58 also holds when the 
a mn are complex numbers. 

We merely need to write a mn = u mn +ifi mn and to consider 
the real and imaginary parts separately. 

4. An example 

can be considered as the sum by rows of 

2 —Z Z + Z 5 —Z 7 

Z 2 — 2 6 +Z 10 — Z U . . . 

Z 3 — Z 9 + Z 15 -”Z 2i • • • 


The array with absolute values has a finite sum by rows if 
k! k.|2 k.|3 


l-|z| 2 ' 1 -| 2 | 4 ‘ l-|z| 6 ‘ ^ 

has a finite sum. But, if 8 is any positive number less than 
unity, and if \z\ < 1— 8, then 1— \z\ ^ 8, and so 


1— I 2 ! 3 > 8, 


>S, 


1 -| 2 | 2 ™ > 8 . 


Thus the terms of the series (2) are less than those of 

S- 1 {|s|+| z | 2 + | 2 | 3 + ...}. 

Hence (2) has a finite sum whenever \z\ < 1. 
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6. Prove that, when 0 < c < 1, 




c(c+l)(c+2) 

3! 


= i. 


7. If the terms a mn of a doubly infinite array can be arranged in a 
single sequence (b n ) such that 2 |& n | is convergent, prove (vide Theorems 
57, Corollary, and 58) that the double series has a sum by rows or 
columns equal to 2 &n* 


8. (Harder.) In the double series 

2' (m 2 + n 2 )~ a , 

m,n 


where both m and n run from - oo to + oo, and the dash denotes the 
omission of the term m = n = 0, show that the number of terms for 
which |m| + \n\ = r, a positive integer, is 4r; that for each such term 
r 2 > m 2 +n 2 > Jr 2 . Hence show that the double series converges if and 
only if 2 rl_2 “ does. 



CHAPTER XVIII 
INFINITE PRODUCTS 


1 . The convergence of infinite products 

1.1. We recall three properties that were proved in 
Chapter XII. These are: 

(i) if oc n -> a, then e a » -> 

(ii) log(l+z) < x when x is positive ; 

(iii) £ < lo gj3| < when 0 < £ < 

1.2. We say that the infinite product 

03 

nx 

n = l 

is convergent if p n = tends to a finite limit v as w 

tends to infinity; a is called the ‘value’ of the product. 

If all the u n are positive, we may write 

__ e lOgU le lOgU 2 e logu n 
— e logu 1 +logu 3 +...+logu n ^ 

By (i) above, if 2 log u n I s convergent and u is its sum, then 
p n ->e u as oo . 

Moreover, if 2 log diverges to plus infinity, then p n -x -f-oo, 
and if 2 log u n diverges to minus infinity, then p n -> 0. 

1.3. Theobem 59. Let ( a n ) be a sequence of positive numbers 

less than unity. Then , as oo, 

m m 

II IT (i-«») 

n=l- n=l 

converge to finite , non-zero , Zimite if 2 ^ is convergent; if 2 
is divergent , then the first product -> +oo, and the second pro- 
duct -> 0. 

We note first that, by the hypothesis 0 < < 1, 

log(l+«J> {— log(l— ( a n )} 

are positive numbers. 

Let J ^ be convergent. Then, by (ii) of § 1.1, 
log(l+a„) < 
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and 2 * s ^ ere f° re convergent. Hence, by (i) of 

§1.1, the first product converges to a finite, non-zero, limit. 
Again, by (Hi) of § 1.1, 

{_log(l— a n )) < -A- < Ka n , 
x—a n 

because (1 —a n )~ L is a sequence that 1. 

\a n -> 0 since 2 a n convergent.] 

Hence 2 {—log(l—a n )} is convergent; so also is 2 log(l— a n ), 
and the second product converges to a finite, non-zero, limit. 

Now let 2 a n divergent. Then, without recourse to 
logarithms, 

(l+&i)(l+ a 2) ~ ^ J r a i~\~ a 2 J r a i a 2 > l-rUi+a 2 , 
and (l+a 1 )(l+a 2 )...(l+a 7l ) > l+%+# 2 +*--+ a »* 

Hence the product 

(l-f-a 1 )(l+ a 2 )...(l+«z n ) 
increases indefinitely. 

Further, 1— < tt — > 

l + a n 

as we see by cross-multiplication. Hence 
(1— a 1 )(l— a 2 )...(l-— a w ) 

is less than the reciprocal of ( 1 + af) . . . ( 1 + a n ) , and so tends to zero . 

1.4. As in the case of series, a n -> 0 is a necessary but by no 
means sufficient condition that (1-f a n ) should converge. For, 
if the product has a finite, non-zero, value, P say, then 
(l+a 1 )...(l+a n _ 1 ) and (l+a 1 )...(l+aj 
each converges to P as n -> co. Hence 1 -f a n -> 1 . 

2. Absolute convergence 

2.1. The series 2 logCl+cqJ will have a sum independent of 
the order of its terms, and so JJ (l+a n ) will have a value 
independent of the order of its terms, if 2 |l°g(l+a n )| is 
convergent. 

Before we give a formal definition of the absolute convergence 
of a product we prove that 

A necessary and sufficient condition for 2 il°g( 1+aJI to be 
convergent is that 2 \ a n \ convergent . 
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If the first series is convergent, then so is ^log^+aj, 
so that log(l+a n ) and l+a n -> 1. Hence a n -> 0 and 

3 N . \a n | < I when n > N. 

When Jwe have 


and so 


log(l+a«) = a n —‘, 


log(l+a„) 1 

< 

1 

■u® 

T 

■l,®» 

J 



2 3 


2 2 2 3 2 


Hence 



log(l+a ro ) 



( 1 ) 


Accordingly, \a n \ < 2|log(l+a n )| when n > A 7 , and so 2 Kl 
is convergent. 

If 2 l®»l is convergent, then again a n -> 0, and (1) proves 
that |log(l+a„)| < f|aj when n^N. Hence £ |log(l+a„)j 
is convergent. 


2.2. Definition. The product JJ (1 +a n ) is said to be abso- 
lutely convergent if 2 a n ^ absolutely convergent. 

By what we have proved in § 2.1, this definition is equivalent 
to saying that the product is absolutely convergent when 
2 l°g(l+ a n) is absolutely convergent. Sometimes the one and 
sometimes the other definition will be found in more advanced 
work. 


3. Uniform convergence 
If the a n are functions of a variable x, and 

p n (x) = {l+a 1 (a:)}...{l+o n (a;)}, 

the product is said to be uniformly convergent if the sequence 
p n (x) is. The properties of uniformly convergent sequences have 
been considered in Chapter XI. 

The one test that is adapted to products is the analogue of 
the M test for series. 

Theorem 60. If \a n (x)\ ^ M n when a ^ x ^ 6, and if 
2 d/ n is a convergent series of positive constants , then the sequence 
p n (x) converges uniformly in a < x < 6. 
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By the M test (Theorem 35), 2 ! a n ( x ) ! is uniformly convergent 
in (a, h). Hence, by an adaptation of §2.1, 2 |log{l+a„(a;)}|, 
and so also 2 log{l +»*(»)}, converges uniformly in {a,b). If 
the latter series converges uniformly to the sum u(x), it follows 
that p n (x) converges uniformly to e u ^ x l 

4. A test for non -absolute convergence 

Theorem 61. If — 1 < a n < 1, and if 2 a \ is convergent , 
then 

(i) IT (1 +a n ) converges when 2 converges, 

(ii) n (!+«») + c0 when J i a n -^ +co, 

(iii) XI ( lJ r a n) -> 0 wJien 1 a n^ —co. 

// — 1 < a n < 1, and i/ 2 is divergent, then JJ (l+a m ) -*■ 0 
when 2 a n i s bounded. 

The proof depends upon the identity 

_£_ = i L 

1+i !+<’ 


which, upon integration, gives 


U 

J 


t dt 
l+t 


= y— log(i+y) 


(i) 


when — 1 <y< 1. Moreover, the left-hand side of (1) is 
clearly positive when y is positive ; when y is negative, equal 
to —z say, the substitution t = —8 gives 


f t dt f 6 

J T+i~ J i 


edd 
-e 


> o, 


0 0 

and again the left-hand side of (1) is positive. 

Hence, for any integers N and p, 

N+p N+p f r tdt 

o < 2 a T~ 2 log(l+a r ) = y jT- . (2) 

r~N r = N J 1 + C 

r—jy 0 

Suppose now that 2 a n is convergent. Then a n -> 0, 
1+ a n — > 1 and, since l+a n > 0 for each n, there is a positive 
K such that (Chap. V, § 1.2, lemma) 

1+ a n > K > 0 for all n. 

Moreover, since some a n are negative, K < 1. 
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It follows that 


when a, 


l a r < JgOh 




2 K 


Hence, from (2), 

N+p N+p 

: 2 Or— 2 

r=N r — N 


N + p 


-rp iv tp i n 

o < 2 a T— 2 !og( 1 + «r) < Tr? / <%. 
r=V r—N -A 


(3) 


r—N 


Hence, by the general convergence principle (Theorem 21), if 
both 2 a n an d 2 a n are convergent, then 2^°g( i + c O * s a ^ so 
convergent, and (i) is proved. 

If 2 a n is convergent, and if 2 a n +°°> then (3) shows that 
2 log(l+a r ) must also -> -f-oo, and (ii) is proved. 

If 2 a n i s convergent, and if 2 —co, then (3) shows that 
2 log(l+a r ) must -> — oo, and (iii) is proved. 

The last part of the theorem follows from (2) on observing 
that, in each integral, 0 < l-j-t < 2 throughout the range of 
integration, so that 


N+p 


r — N 


N+p 

- 2 log(l+a r ) 

r = N 


> 


N +p 


Iflrl 


. 2 J 

r — N i 


t dt 


N + p 


i 


at 


r—N 


Examples XXIII 

1. Prove that each of the products 

n(>+a- n(*-a- rtM 

n= 1 n—2 n — 1 

converges to a finite, non-zero, limit. 

2. Prove that 

n(>-9- fi('-s) <*>»> 

n — 2 n= 1 

each tends to zero as N—> oo. 

3. Prove that the second product in Example 2 tends to infinity when 
x < 0. 
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4. Prove that 

lioisfn-— 1— - = +^1- + M! + ) 

i 0g r^n/ n 2n 2 ^3n* in 2 ! ' n * n 2 1 "T 

Hence show that, if \x\ < A, 

log ( 1 + 3 - s < ^{ 1 + §+i + -} 


i 

when n > 2 A . 

5. Prove that 


n(*+s 




is (i) absolutely convergent for any fixed x 9 

(ii) uniformly convergent for \x\ < A f where A is any fixed number. 


6. Prove that 


n(*-*) 


is (i) absolutely convergent for any fixed x , 

(ii) uniformly convergent for \x\ < A, where A is any fixed number. 

7. Verify the identity 

(•-fH’-D-f 1 -;) - 

Prove that, when # > 0, the product -> 0 as n -> oo. 

8. By means of Example 7 show that 


when x > 0. 




9. Prove that, when ]g| < 1, each of the products 

<?o = n (i-<z 2n )> ?i = n d+s 2n ), i 

th-Tia+q 271 - 1 ), = IKi-? 71 - 1 ), > (n ~ ’ v '* } 

is absolutely convergent. 

Prove also that 

? 0?3 = II (1-2”). = n ( 1 + 2 n ). 

and 5i ?2 ?3 — 1> 

further that 

(l + 2 )(l+2 2 )(l+ 3 3 )... = 1/(1— «■)(!— a*).... 

10. Prove that, -when |a;| < 1, 

(1+*)(1+**)(1+* 4 )(1+**)... = (l—*) -1 . 
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11. Evaluate 
and hence prove that 


^ . x x x x 

2*sm-.cos-cos^...cos-, 


XXX 
COS - COS — cos — . 


S1I12: 

X 


12. {Harder.) Find the limit as n -*> co of 


n{(i-2 2 ”)/(i+s 2m )} <5r 

m = 0 

when 0 < q < 1. 

13. Prove that 11 1 

t t ~f* 1 t{t ~}~ 1 ) 

1 1 1 2 

t 2-f-l (£-{- 1 )(£-{- 2) ^ (i — j— 1 )(^ — f~ 2 ) 

and, more generally, that 

n—l 

1 1 'ST rl _ n\ 

t 2-f-l ^-4 (£-{- 1 ) l)***(£~f-^) 

r=l 

14. Use Examples 3 and 13 to prove that 


1 __ 1 t V n\ 

t £-f-l 2~t (2-f- 1 )(i — j— 2 ) . . . (i ?T/ — }— 1 ) 

n=l 

15. Prove that if b > a, then 


q(q-f l)...(q-f-n) 
6(6 + l)...(6+n) 


provided that b is neither zero nor a negative integer. 


Hint. 


6-fn _ j j_ b—a 
a-\-n 1 a-j-n’ 


and the series 2 (a+n) 1 is a divergent series whose terms are ulti- 
mately positive. 



CHAPTER XIX 

THEOREMS ON LIMITS: CESlRO SUMS 


1 . A general theorem on limits 
1.1. Theorem 62. If (b n ) is a sequence of positive numbers 
that increase steadily to +oo 5 and if the sequence (a n ) is such that 

— ~ a finite limit i, (1) 

^tt+X b n 

then also “(2) 

In the first instance, suppose that l = 0. Then, by hypo- 
thesis, 

e 3 h > 0; 3 N . —eh < < eh when n ^ N. 

b n -i-l~ 'bn 

Since b n+1 —b n is positive, we have 

€&(& n+ i b n ) < a n+x —a n < eh{b n+1 —b n ). 

Write down this inequality for n = W, W+l,...,A 7 +p— 1, and 
add: we obtain 


—eh(b N+p —b N ) < a N+p — a N < ek(b N+p —b N ). 


A fortiori 
Hence 


—ehb N+p < a N+p —a N < ehb N+p . 


a N+p 

< 

a N+p~~ a N 

1 

a N 

t>N+p 

b n+p 

w 

b N+P 


< e& 


&N+p 


But, if N is kept fixed and p — > go, b N+p -> 00 (by hypothesis). 
Hence 3 P . when p ^ P. If, then, we take 

h = \ at the start, we have proved that 


€ > 0; 3 numbers N, P 


ptj < e when n ^ N-{-P, 


and the theorem, with l = 0, is proved. 
Now suppose that l ^ 0 in (1). Write 

■^n ®7i 


-^n+l l > Q 

b n +i bji ^n+1 b n 


so that 
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Then, by what we have already proved, 

0, i.e. p — l-* 0, 

K K 

and the theorem is proved when l has any value. 

1.2. The converse of the theorem is not true as a general 
proposition. Because (2) holds it does not follow that 

(*»+ l- a n)l(K+l-K) 

will tend to a limit. Bor example, if 

®2n ~ ^2n+l “ h b n — 7l } 

then (a n lb n ) -> 0; but 

a 2n+l a 2n __ | a 2n a 2n-l __ j 

^ 2n+l ^2n ^2 n ^2n-l 

so that (a n+1 —a n )l(b n+1 —b n ) cannot tend to a limit. 

2. Particular cases of Theorem 62 
2.1. When b n — n } the theorem takes the form 

(i) if a nJrl — a tl -> l, then also — l. 

Tt 

When we put a n = ai+a 2 + •••+&, 2, in (i), we have 

(ii) if a n+1 l, then also 

77 / 

a theorem that is frequently used in advanced work on series. 
Turning now to products, we have, on putting 

“n, = Pn (Pn > 0). 

(hi) if Pn -+ P> then also VO ®iPz-Pn) ~>P- 
Again, if we put 

Pl = Kl. Pn = KK-ll (» > 1), 

we have 

(iv) if K/«n-il -> P, then also %lu n -> p. 

Finally, as a numerical example, put 



Pi @2 ’"Pn 


(n+ l) n 


so that f3 n -> e. Since 
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the form (iii) shows that 

n+1 n 

W)~* e ’ or W)~* e ' 

2.2. In each of the particular cases (i)-(iv) the remark ma de 
in § 1.2 about the general theorem still holds. The first limit 
need not exist because the second does. 


3. Conventional sums of non - convergent series 
3.1. Suppose a sequence (s n ) is given. Then the sequence of 
its arithmetic means 


t 


n 


a i+s 2 +-+* n 

n 


(»= 1 , 2 , 3 ,...) 


cannot fluctuate with greater violence than does the sequence 
(sj; it may well fluctuate with less violence. Modern mathe- 
matics makes considerable use of non-convergent series by 
means of a technique that began with this simple considera- 
tion. 

The ‘sum’ of a series, as we have hitherto used the word, is 
defined thus: 

The sum of J \ is 5 if s n = ^ 1 +w 2 +--*+ u n an( i s n~> 5 * 
There are many series met with in analysis for which (s n ) is 
not a convergent sequence, although its fluctuations are mild 
enough to be ‘ironed out 5 by the process of taking arithmetic 
means; that is to say, (s n ) is not a convergent sequence, but 
(t n ) is. It is natural to take the limit of t n as the ‘sum’, in a 
special sense, of the series in question. Such a sum is called 
the (C, 1) sum of the series, the C recalling its inventor Cesaro 
and the 1 denoting the first of such sums (the second, third,... 
being derived from similar, but less simple, considerations). 

Definition. The series 2 sa ^ io ^ ave a (£7,1) sum s if 
t n -+s as n-> oo, where 

t n = x ~^" s n = %+^2+***+^»* 

Tb 


3.2. It would lead to intolerable complications if it so 
happened that a series might have one sum in the ordinary 
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(convergent series) sense and another sum in the ( C , 1) sense. 
But, as we see by Theorem 62, particular case (ii), 

if s n ~>s, then t n -> s ; 

that is to say, if a series is convergent, then its (£7, 1) sum is the 
same as its sum in the ordinary sense. 

As it is rather unsatisfactory to have such an indirect proof 
as the one we have just given, we shall give a direct proof. 

Theorem 63. If s n -> s, and if 

* __ S l + S 2 + -" + 5 n, 

* n n * 

then t n s. 

We have at once 

t n -s = I{(s 1 -s) + (5 2 -s) + ... + (5 rt -5)}. 
n 

The sequence s n -~s-+ 0 , and so, by Theorem 1 , is bounded. 
Hence 

(i) 3 K . |s„— <5 1 < K for all n 9 

(ii) e > 0; 3 N . |s n — s\ < \e when n ^ N. 

Take a definite such value of N ( > 1) and let n > N . Then 

U „■ ^ (^-1)^ , (»-tf+l)« 

\t n -s\ < — + ^ 


< (N-iyK 

n 



But N, K are fixed, and w r e can make the last expression less 
than e by taking n > 2(N—1)K€~ X . Hence 


e > 0; 3 N x . \t n — s| < e when n ^ N v 


4. The more general form of Theorem 62 
The full force of Theorem 62 cannot be realized from the 
elementary point of view, which confines itself to sequences 
(a n ) that tend to a limit. The two limits 

lim oi n and Km <x n 

are necessary to a full statement of Theorem 62. 

We refer the reader to the appendix for a definition of these; 
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meanwhile, we note that, if (h n ) is a sequence of positive 
numbers that increase steadily to -f oo, then 

li m ?ZL±I — ~ ^ lim^- > lim~^ > (1) 

K+i-K K — h n — b n+1 ~b n 

and a sequence (oc n ) converges to a finite limit a if, and only if, 
lim ol u = lim oc n = a. 

If the two extremes of (1) are equal, the middle terms must 
be equal and have the same value as the extremes; but the 
converse is not necessarily true, since the middle terms may be 
equal and the extremes unequal. 


Examples XXIV 


1. Prove that, if 


c(ri _ , ,»•(»•+ 1) . r(r+l)...(r+w-l)_ 

and A ^ = (r-}-l)(r+2)...(r-f n)/nl f 

and if l , then, provided that r > 0, 

S<?/AM-+l. 

f o(r) o(r) _ o(r-l) . j (r) _j(r) _ j(r-l)*] 

L°n+1 ~ °w+l » ^fl+1 “ -“■»+ 1 *J 

2. If s n — > as n — > oo, prove that each of the sequences 

(i) 2n*" 2 (5 n +25 n _ 1 4-...+n5 1 ), 

( ii) ± {«i(i + 3 + ... + ^ +*4 + 5 + - + 3 + - +•«© ) 

also tends to s. 

3. (Harder.) P(n) denotes the sum of the products, in pairs, of the 
pth powers of the first n positive integers; prove that, if p -\- 1 >0, 

P(n) 1 

i as n — > oo. 

( n+ l)a2)+2 2tp-hl) 2 

4. Prove that the (C, 1) sum of the series 

1-1 + 1-1 + 1 -... 

is 

5. If a n -> a and b n -> 6, then 

~:( a l^n + a 2^n-X+"* + a n^i) ""*• a ^* 


Hint. Prove the theorem first when a = b = 0. To do this, note that 



158 


THEOREMS ON LIMITS: CESARO SUMS 


one of the suffixes r,n— r must exceed N if n > 2N. Let \a n \ < A, \b n \ < B 
for all n. We have 

€,Jc > 0; IN. | a n \ < ek, \b n \ < ek when n > N. 

Hence, when n > 2N and K is any fixed number > A, B, 

i(a 1 b n +-+a n 6i) < 

To 

and the result follows on taking k = 1 jK. 

6. If 2 c n is a divergent series of positive terms and (d n /c n ) 5 , then 
also {(d 1 + d 2 + ‘*‘ + ^n)/( c X"f“ c 2 - f"***“f c n)} “ > 8 * 

Hint. Put c 1 -j-c 2 +«~-rC n = 6 n in Theorem 62. 

7. If p n is positive and {pj (p 0 + . . . + 2 > n )} -> 0, prove that -» 5 implies 

-•-+ffoSw ^ g 

Pn+Pn-i + -+Po 

Hint. Cf. the method of proving Theorem 63. 



CHAPTER XX 

FOURIER SERIES 


1. Periodic functions 

A function f(x) such that f(x) = f(x+Q) for all values of 
x, where Q is a constant, is called a periodic function of x, 
and Q is called the period of the function. For example, sin a; 
and cos x are periodic functions. 

If we are given a series 
00 

2 a 0 + 2 ( a 7 i cos nx + sin nx) (1) 

71=1 ' ' 

that converges for all values of x, then its sum is necessarily a 
periodic function of x, for each term is unaltered when x+2tt 
replaces x. 

The problem of this chapter is to find when, given a periodic 
function /(x), of period 27 r, the function can be expressed as the 
sum of a series of type (1). 

2. Elementary properties 

The following facts in integral calculus form the basis of all 
the subsequent work. Throughout we use m, n to denote positive 
integers or zero. 

77 7 T 

J cos inx cos nx dx = J J {cos(m+n)x+cos(m-—n)x}dx 

— 7 r —7 r 

= 0 3 77 according as m =£ n, m = n; 

rr 77 

J sinmxsirinx dx = | J {cos(m— n)x— cos(m+n)o;} dx 

— 1 T —77 

= 0 3 tt according as m ^ n, m = n; 

IT 77 

J cos tux sin 7ix dx = J {sin(?z-l-m)a:+sin(7i— m)x] dx 

— 77 —77 

= 0; 
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7T 

J cos mx dx = 0, 2tt according as m > 0, m — 0; 

— 7T 


J 


sin mx dx = 0. 


— T7 


3. Fourier series 

3.1. If numbers a 0 , a v ..., a n b v b n ,... are derived 

from a function f(x) by means of the equations 

TT TT 

7ra n = J f(t)cos nt dt , rrb n = J f(t)sinnt dt, (2) 

— 7T — TT 

then the series 

00 

■2«o+ 2 ( a n cos sin nx) (3) 

n = 1 

is called the Fourier series of f(x). 

The series (3) is not necessarily convergent because the 
numbers a n , b n are so defined; even if the series is convergent 
its sum is not necessarily f(x) } though it often will be. 

The numbers a n) b n are called the Fourier coefficients of 

3.2. The relations between a function f(x), its Fourier 
coefficients, and its Fourier series have been the subject of 
extensive resear ch.f 

We shall here prove only two theorems, Theorems 64 and 65, 
both concerned with stating conditions under which a Fourier 
series can be used to represent the function from which it is 
derived. 

Theorem 64. If the series 

CO 

ia 0 + ^ (a^o^nx + b^mnx), 

71=1 

where the a n , b n are constants , is uniformly convergent in (—77, n), 
and iff(x) is its sum , then it is the Fourier series of f(x). 

f See, for example, A. Zygmund, Trigonometrical Series (Math. Monographs, 
Warsaw, 1935), where the theory of Fourier series is developed. 



FOURIER SERIES 


161 


The proof of this theorem is a straightforward deduction 
from the properties we have given in § 2. We have 

00 

f{x) — la 0 + 2 ( a n cos nx + K «*)• (4) 

n = l 

Since the series is uniformly convergent in {—it, it), we may 
multiply by cos raz (m > 1) and integrate term by term. When 
the integration is from — tt to it, all the terms of the resulting 
series are zero (by § 2) excepting only 

TT 

a m f cos 2 mx dx, 



This last step shows that the term %a 0 (and not a 0 ) is necessary 
if the definition of a n by means of (2) is to hold for n = 0 as 
well as for n ^ 1. 

3.3. The other theorem we shall prove is much more difficult 
to establish. It will form the basis of the examples we shall 
give and is, par excellence , the practical form of Fourier’s expan- 
sion of a function in a series of sines and cosines. 

We need a preliminary definition. 

Definition. Iff(x+h) tends to a definite limit as fi tends to zero 
through positive values , then this limit is denoted by f(x- fO). 

If f(x—h) tends to a definite limit as h tends to zero through 
positive values , then this limit is denoted by f(x—Q). 

If a function is continuous at x } then 

f(x+0) =f{x- 0) =/( x). 
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Examples. 



In Fig. I we have the graph of a continuous function. 
If we take any definite x , say x — 1, then 

f(l+h) ->/(l) as A-> 0, so that /( 1 + 0) =/(l); 
/(l— A) ->/(l) as A -> 0, so that /(l— 0) = /( 1). 



In Fig. 2 we have the graph of a function that is discon- 
tinuous at x = 1, 2 ,.... When A is small and positive the 
point {1— A ; /(l— A)} lies in OA; as A 0, /(l— A) 1. That is, 

/( 1 - 0 )= 1 . 

On the other hand, the point (1+A,/(1+A)} lies in CB; as 
A -> 0, /(1+A) -> 0. That is, 

/( 1+0) = 0. 

3.4. Theorem 65. Letf(x) be a periodic function of period 2 tt 9 
so that f(z+27r) — f{x); let \f(x)\ be integrable in (—77,77) and let 
a n , b n be its Fourier coefficients. Then 

i a o + 2 (a n cos nx + b n sin nx) = i{f(x+0) +f(x— 0)} (5) 

n = l 
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whenever 

(i) the series is convergent 
and (ii) the limits on the right of (5) exist. 

The limits /(s+O) will not exist for all functions: for example, 



does not approach a definite limit as h 0. 

3.5. We return to a proof of Theorem 65 later. We first 
dispose of more elementary considerations, assuming mean- 
while the main result of Theorem 65, namely, that with the 
given conditions 

‘equation (5) holds whenever both sides make sense \ 

Let a function f(x) be given, not necessarily periodic. Define 
a new function thus: 

When — 77* ^ x < 77 , define F(x) to be f(x); for other values 
of x let F(x) be defined by the relation 
F(x+2n) = F(x). 

Then, if \F(x) \ is integrable in (—77,77), its Fourier series, when 
convergent, has for its sum 

tfJF(*+0)+JF(*-0)}. 

We assume, of course, that these last limits do exist. 

In the interval —77 < x < 77, this is %{f(x+ 0) +/(£— 0)}. But 
F(ir+h) = F(rr+h-2ir) = F{-n+h) = /(-7r+Ji), 
and F(7r-h) — f^—h), 

so that F(77+0)+F(77— 0) = /(— 77+ 0)+/(^“0). 

Hence the sum of the Fourier series of F(x) at 3 = 77 is 

i{f(— ”+ 0) +/( ? 7— 0)}. 

Outside the interval (—77,77) the Fourier series is related to 
F{x) and not to f(x). 

3.6. A worked example. Find the Fourier series that represents 
e x in — 77 < x < 77. 

The function e x is not periodic and so, in order to have an 
appropriate periodic function, we define a function thus: 

Let f(x) = e x when —77 ^ x < 77, 
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and let f(x) be defined for all other values of x by means of the 
equation /(s+fcr) =/(*). 

For example, the value of f(x) when x = f tt would be given by 

/(§7r — 2 tt), i.e. e“K 

The Fourier coefficients of f{x) are given by 

7 r 

7ra 0 = J e* d# = 2 sinh7r, 

— 7T 

? f \\m 

7 i ra m = e* cos ma; do; = — 5-— 2 sinh tt, 

m J ra 2 +l 

—7 r 

? ( 1 ) m m 

tt-6 — e x sin mx dx = 0 - 2 sinh tt. 

m J m 2 + 1 

— 77 

Hence the Fourier series of f(x) is 

2sinh7r(l . ^ (— l) 71 , . T 

~ 2+Z (6) 

V 71=1 ‘ ’ 

Each of the series 

2 (— l) n cosn#/(n 2 +l), ^ (-~l) n 7 isin?ia;/(^ 2 +l) 
is convergent [cf. Chap. IX, §3.5: (— l) n sin nx = sin n (a; + 77 )]. 
Moreover, when — tt < x < tt, 

f(x-\-0) = lim = e x , 

Tt— >0 

f(x— 0) = lim = e x . 

h — >-0 

Hence (6) is equal to e x when —tt < x < 7r. 

When x — tt or —tt we must consider carefully how /(#) is 
defined. By definition, when h > 0, 

/(tt+A) = /(tt+A— 2tt) = e-” +h , so that/(7i+0) = e -77 , 
f(rr — Ti) — e 7T ~ h , so that /(tt— 0) = e 77 . 

Hence, when x = tt, the sum of the series (6) is not e 77 , but is 
i(e-*+e*). 

Similarly, 

/(— 7r+A) = e -77 ^ and /(— tt+ 0) = e~ n , 
f(—TT—h) — f(—7T—h J r 2Tr) — e 77 -^ and /( — 77 — 0) = e 77 . 
The sum of (6) when a; = —tt is, therefore, ^(e-^+e 77 ). 
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4. Sine series and cosine series 

4.1. If f(x) is an evenf function of x, then 

77 

J f(x)sinmx dx — 0 

— 7 7 

and the Fourier series of f(x) is a series of cosines only. 

Similarly, if f(x) is an odd function of x, then its Fourier 
series is one of sines only. 

4.2. We can find series of sines or cosines, as we wish, that 
are related to a given function f(x) in (O.77), though not 
necessarily so related outside this interval. 

Take any function f(x) that is integrable in (0, 77) and define 
two new functions thus: 

in OsgzO, let <f>(x)=f(x), ijj(x) = f(x); 

m—rr<x<0, let cj>{x) ==/(— x), tjj(x) = — ■/(— x); 

for other values of x let <f>, ifi be defined by the periodicity 
equations ^ x+5itT ) = <f>(x), ^(x+2n) = ^{x). 

Then the Fourier series of the even function <f){x) is 

CO 

i-« 0 + 2 a n COS nx , (7) 

n = 1 

77 77 

where r na h = J <f>(x)coslcx dx = 2 J f(x)ooskx dx. 

— 77 0 

Assuming the Fourier series of cf)(x) to be convergent, its sum 
will be +</>(#— 0)} when these two limits exist. This 

sum is : 

for 0 < a; < 77, Uf(x+0)+f{x— 0)}; 

for x — 0, K/(+0)+/(+°)} i- e -/(+0) ; 

for x = 77, %{/(*— 0)+f(ir— 0)} 0). 

For other values of x the sum is related to <{>(x) and not to f(x). 

f Definition. f{x) is an even function of x iff(-x) — f{x); 

f(x) is an odd function of x if f(—x) = —/(*). 

When f(x) is an even function, 

77 77 77 

J f(x)smmx dx = J f(x)smmxdx — J f(t)sinmt dt — 0, 

— 77 0 0 
as we see by putting t — ~~x in the interval — tt < x < 0. 
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The Fourier series of the odd function ift(x) is 

CO 

2&„sinnx, (8) 

n~l 

7T 7T 

where 7 rb k = J 0(x)sin kx dx = 2 J /(x)sin Jcxdx. 

— 77 0 

The function ^{^r(a;+0)+^(a; — 0)} is |{/(#+0)+/(x— 0)} when 

0 < ^ < 7T. 

When x = 0 3 tt the sum of (8) is clearly zero. For values of 
x outside ( 0 , 77) the series is related to ip(x) and not necessarily 
to f(x). 

4,3. A worked example. To find the series of sines that represents 
x 2 in 0 < x < 77. 


Let fix) = x 2 when 0 < x ^ 77, 

f(x) = — x 2 when — tt < x < 0, 
and let f(x) be defined by the periodicity equation 
/(x+2t7) =f(x) 

for values of x other than —77 < x < tt . 

The Fourier coefficients of f(x) are given by 

a n = 0, since /(x) is an odd function, 


776 n 


J x 2 si: 


sin nx dx 


2 t 7 2 (-1)”+ 1 4 


n 






( 9 ) 


The Fourier series of f(x) is 2 b n s bi nx > where b n is defined by (9). 
This series is convergent (Chap. IX, §3. 5 proves 2(— l) n+1 n~ 1 sin7ix 
to be convergent) and its sum is i{/(x+0)+/(x— 0)}. 

When 0 < x < 7T, /(x+0) = /(x— 0) = x 2 , and so the sum 
of the series is x 2 . 

When x = 0 or 77 the sum is zero: outside (0, 77) the series does 
not represent x 2 . 


5. Intervals other than (—77,77) 

5.1. If we require a Fourier series to represent /(x) in 
(0, 277) we proceed as in §3.5, but we use (0, 277) instead of 
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(— 77 . 77 ). Thus, to represent a; in the interval (0, 2 tt) we calculate 

2tt 2tt 

a 0 = i j x dz, a n =:-jx cos na: dx 9 
o o 

2tr 

= i J arsinna; da:, 


and so obtain 


X = 77—2 


(0 < x < 2tt). 


5.2. We can make the interval (a,h) correspond to the 
interval (— 77 , 77 ) by means of the transformation 
x—a __ X+7r 
b—a ~~ 2 tt 5 

. v 2 ttX — Tr{a~\-b) 

1 , 0 . XX. — — ~ * 

b—a 

To represent f(x) by a Fourier series in (a, b), let f(x) = F(X) 
and let „ 

na k = J F(t)coslctdt 

= m cos ^ 

a 

7T 

7rb k = J F(t)sinictdt 

— TT 

= f 

b—a] JK ' b-a 

a 

Then, assuming the convergence of the series and the existence 
of®the limits, we find that 

00 

$a 0 + 2 (a„coswX+& re sin«X) 

n = l 

represents ^{J , (Jl+ 0)+J?'(X — 0)} in —n < X < v; and so 
K+ 2 [a m cos^(2a:-a-6) + 6 Jl sin^(2 ; E-a-6)l 
represents i{f(x + 0) +/ {x — 0} in a < x < b. 
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6. Proof of Theorem 65 

6.1. Theorem 65 a . Let \f(x ) | be integrable in (—77,77) and 
let f(x) have a period 2 tt; let 

IT TT 

■na k == J f(t)coslct dt, -nb k = J f(t)sm Jet dt, (1) 

— 77 “* 77 

n 

s n — ia 0 + 2 ( a m cos mx + b m sin mx), (2) 

771=1 

and let = ^±£l±ri±£-i. (3) 


n 


Then , for any x such that the limits f{x J r 0), f(x— 0) are defined , 


-> H/( a: + 0 )+/( a: - 0 )}- 

step. By (1) and (2), 

77 n 77 

«„ = ^ J ^ * + ~ 2 / dt 


(4) 


1 r sin {(n+\)(x—t)} 

' 2n J 


sin I (a;— t) 


f(t) dt, 


on summing the series |-+cos(a;— + cos 71(2;— t). 
Now put t—x — u\ we get 


1 f si: 

~ 2t7 J 


sin(n+i)^ 


sin \u 


f(u+x) du. 


But the integrand has a period 277, and so its values from 
77 x to —77 are repeated in its values from ir—x to 77. Hence 


1 f Sin(»+H« 
J sin \u 


277 


du 


0 


on writing —u for u in (— 77 , 0). 



FOURIER SERIES 


169 


On summing sin lu + sin + . . . + sin \(2n—l)u, we get 


7T 



0 


(5) 


But we also have, on taking the particular ease f(x) ~ 1 (when 
a Q = 2 is the only Fourier coefficient that does* not vanish, and 
so s n = 1 and cr n = 1), 


1 = j_h^,_ d , 

2nn J sm 2 |w 
o 

If s is any given number, then, by (5) and (6), 


( 6 ) 


77 



0 


where <f>(u) = f(x+u)+f(x— u)—2s. (8) 

Parenthesis . What we have to prove is that (7) will tend 
to zero as n tends to infinity if we take s to he 0) +f(x— 0)}. 

The first step has been concerned solely with arriving at a 
suitable form for cr n —s. 

Second step. Let 8 be any fixed positive number less than tt. 
Then 

77 

cosec - 18 f \6(u)\du. (9) 

n “ J 
8 

By hypothesis, \f(x)\ is integrable, and so the integral on the 
right of (9) is a finite number, independent of n. Hence (9) 
tends to zero as n tends to infinity. 

This disposes of the interval (8, ?t). We begin our attack on 
the interval (0, 8) by noting that 

cosec 2 ^“(-|z4)“ 2 


1 f sin 2 -J-m£ 
n J sin 2 ize- 


cf>(u) du 


is bounded in (0,8) (expand (sin|-^)~ 2 and use the analogue of 
Chap. XV, § 4). It follows that 


1 

8 

si n 2 lnu | 

nj 

1 - \ 

0 



( 1 _ 

1 

\sin 2 i% 

(^) 2 / 


i du 


8 

K\(f>(u)\ du -> 0. 
o 
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But the expression (9) also tends to zero, so that (7) will tend 
to zero if, with a definite positive 8 less than 77*, 

S 


n J u 2 


( 10 ) 


Third step. Suppose now that x is a value for which 

2 •{/(^+o)+/(^—o)} 

is defined — i.e. the limits exist — and put s = f{/(#+0) +/(#-■-• 0)}. 
Then <f>(u) = f(x+u)+f(x-u)-f(x+0)-f(x-0), 
so that, by the definition of <f>(u), <f>(u) -> 0 as u -> 0. Hence 
£ > 0, A > 0; 3 7j . \<f>(u)\ < ejA when ]^| < rj. 

We now take a definite rj, choosing it to be less than 8. 
Then, for all n, 

i 8 

1 f sin 2 -|mi ,,, j 

- 1 —$(u)du 

In J u 2 




An 


J u 2 n J 


sin 2 ^7m 


u * 


\$(u) \ du 


0 v 

= A+-4> 

say. But, on putting v = -|m4 in the first integral, 

^ # £7177 co 

1 f sin 2 -|?m , If sin 2 ?; , If sin 2 ?; , 

- du = ~ — — dv < - — — dv, 

n J u» 2 J v 2 2 J v 2 

0 00 

which is a positive constant; if we take 
A f sin 2 y , 

A =i 


we have, at this point, 0 < ^ < |e 

5 

0 < / 2 < 1 

71 

V 


ft J 

V 

8 

< n^r ]- 2 J [^(w)| dw. 


Again, 
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Since 77 , S are fixed, we can find an N for which 
0 < I 2 < ie when n > N. 

Hence 


€ > 


[lfsin^ I 
mj w 2 r I 


< e w hen n ^ N. 


That is, (10) is true and, by the second step, (7) -> 0 as n -> 00 ; 

thatis ’ c n -i{/(x+0)+/(^-0)}. 

6.2. If, further, tends to a finite limit, that is, if the series 


\ a Q + 2 ( a m cos + b m sin m#) 

m=l 

is convergent, then (Theorem 63) <j n tends to the same limit as 
does s n . Hence Theorem 65 follows from Theorem 65 a. 


Examples XXV 

1. Prove that 

7 t—x sin# , sin 2# , sin 3# , _ . 

_ = - r+ _ + _ 1 _ + ... (0 < » < 2tt). 

2. Prove that the function f(0), where 

f( 6 ) = $6(77— a) when —a < 0 < a (< 77), 
f( 0 ) — $cc{tt— 6 ) when cc < 6 < 27 7— a, 
can be represented in ( — a, 27T— a) by the series 
X ^“ 2 sin nO sin na. 

3. Prove that, when 0 < x < 77 , 

1 , 1 o , 1 - , \ 

x — 77 (cos#-f — cos 3 #-f-r 7 Cos 5 #+...J. 

Z 7 T \ o* 0^ / 

4. Find the cosine series that represents x 2 in (—77,77). 

5. Show that X & n s i nna7 > where 

, 8 7177 . 7177 . 7777 

6 » = -^ cos T sm T sm T 

represents in ( 0 , 77 ) the function i{f(x+0)+f(x — 0)}, where f(x) is ^77 
when 0 < x < J77, is zero when £77 < x < §77, and is — £77 when 

|77 < x < 77 . 

6 . Prove that, in — 77 < x < 77, 

x+x 2 — j 77 2 + 4(— cos#-f Jsin#) + (cos2#— sin 2#) + ... . 

7. Prove that, if — 77 < x < 77, then 

77 2 * — # 2 = §77 2 + 4(COS# — Jcos 2x + 9 COS 3# — ...). 
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1. Prove that 2 nkz<n convergent when \z\ < 1. If F k (z) is its sum, 


show that 


Ji+iW = 


and that, when k is a positive integer, 

r = 0 

where the A r are positive constants. (Use induction.) 

2. From the formula 

n - 1 

n sin nd "Sp sin 0 


V 

T-i ~ 2L c 


cos ft#— 1 cos#— cos2ra’ 

r = 0 

where a = w/n, deduce that 

n-1 

}(n 2 — 1) = 2 cosecVa. 

r = 1 

3. Given that 2 is a divergent series of positive terms, show that 
2 a n /(l+ft 2 a n ) is convergent and 2 a n /(l-f a n ) is divergent. 

4. Show that the double series 

(m,n = 0,1,2,...) 


converges by rows or by columns to (1 — a;)" 1 provided that —2 < x < 1. 

5. The series 2 a n is convergent, and 

h = . gg±i _L 

°*“n+l + n+2 + -* 

Transform 6 n .by Abel’s identity (sum the a’s, and difference the 
1 /(w-fr); see p. 62) and prove that nb n -> 0 as ft -> oo. 

Show further that, if J5 n = 6 0 -b&i + ~* + & n , -An = a 0 +a 1 -f*...+a 7l , 
then A n — J5 n — (n-|- l)6 n+1 ; and hence show that 2 — 2 

6. Discuss, for all real values of x , the convergence, and in particular 
the ranges of uniform convergence, of 

2rc' 1 (l+tf n )- 1 (-z) 7 h 

7. Find the sums of the series 


2 (9 ft*-ft)-i, 2 «n+l)(2» + l)}-* 

71 = 1 71 = 0 

8. If y+y” 1 = i-rirji prove that {(1— ty)(l— ty* 1 )}^ may be ex- 
panded as a power series in t convergent when \t | < co, where 0 < co < 1, 
provided that the point (£, rj) lies either on the ellipse 

£ 2 , rf _ 1 

(to+co - 1 ) 2 + (or 1 — a >) 2 = 


or inside this ellipse. 
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9. If a n * s m *d. and 0, and if <f>(n) = 0(ri fc ), prove that the con- 
vergence of 2 \a n 4>(n)\ implies n kJrl a n -> 0. (Compare Pringsheim’s 
theorem, Examples VIII, 12.) 

10. If 2 a n xn is absolutely convergent when \x\ < R and B > 0, 
show that 2 a n xn l n ' converges for all values of x. 

11. Find the radius of convergence of the power series 
1.3...(2ra — 1) | 


2.4...2n 


'(i+1+...+i)^ 


and discuss the behaviour of the series on its circle of convergence. 
12. Prove, by using partial fractions or by any other method, that 
J y (JOS 0 

1 — 2rcosfl+f * = 1 + ^o^+^ 2 cos 25 + ... (|r| < 1), 

1 -i - ^W+r* = l+2rcos0+2r 2 cos20-f ... (|r| < 1), 
rsin0 


l-2rco S 0+r* = «in5+^sin20+... (|r| < 1). 

[(l-2reos0+r 2 ) = (l-re ie ){l-re~ ie ).] 

13. Find the series of cosines that represen ts 

d 

— log( 1 — 2r cos 9 + r 2 ) , 

and hence prove that 

— £log(l — 2rcos0+r 2 ) = r cos0 + Jr 2 cos20-f ... (|r| < 1). 

14. Use 13 and Abel’s theorem to prove that, when 0 < 8 < r, 

cos0-f£cos 29+ % cos 3#-r ••• = — log(2sin W). 

15. When |x| < 1, prove that 

i|log(l-|-2a;sin^+^ 2 ) = asin 0 +i 2 2 cos 20— i.r 3 sin30— ... . 
Prove that, when n is a positive odd integer, 

sinn0 7i(n 2 — l 2 ) . n(n 2 — l 2 )(n 2 — 3 2 ) . a 

sm 0 3 1 ol 

16. If 2 nc n ^ convergent, then so is 

c n % c n+i ”1“ ^ c n+2 d* • • • > 

and its sum -> 0 as n -> oo. 

17. Prove that, in the usual binomial coefficient notation, 

(”)4Q+-+<-Kd- 1 +H+-+;' 



174 


MISCELLANEOUS EXAMPLES 


18. Prove that 


satisfies the differential equation 


© w ( K ) w ... + ( i # s=jy 


# w -f ... 


xa-z)^+(l-2x) d £-iy~0, 

and find the radius of convergence of the series that defines y . 

19. Prove that 1 — 1 — i~~ J-f. J-j- J- — ... (the 
series containing blocks of 1, 2, 3, 4,... equal terms) are convergent series; 
but that 

(with blocks of 1, 2, 4, 8,... equal terms) is not convergent. 

20. If b > 0 and 2 ^n 1 is & divergent series of positive terms, prove that 

^ ‘ c l a '2 , ** ic n+l bXiX%", x %>+\ 


LI^ V { x x- h )>~ 
J #1 2^1 ^2 * * * 




21. The function /(s) is defined by 




Deduce from the series, and without quoting properties of trigonometrical 
functions, that 

(i) J(x)f(y) =f(x+y), (ii) j/(as)| = 1, (iii) ~a T gf( x ) = 1. 

Prove that f(x) is a periodic fimction of x . 

[Note: |a-ft'6| 2 = (a-j-i&)(a— i&).] 

22. Use the inequality (2 a„&„) 2 < (2 a \ )(2 &l) to show that 

O0 00 

2 a n ^Vr-ic ^ convergent when 2 2 are convergent. Prove 

n= —CO 71 ~ —CO }l= —00 

that its sum — > 0 as & oo. 


23. The number of sets of values of ?n x , (integers not all 

zero) whose absolute value < x is (2a;+ 1)^—1. The number of sets 
where these absolute values < x is (2x— 1)*~1. (The m 9 s may be 
positive or negative.) If & = 2 + a multiple sum, and 

S x is the sum of the terms wherein at least one \m\ has the value x , then 

(2s-f l)*-(2s-l)fc ^ c ^ 1 (2a: + l) fc — (2cc— l) fc 

S 2 * ‘ 

CO 

Hence show that S converges when 2 ^" 1 ~ 2a: converges. 
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24. When n is a positive integer, prove that 

1 —x 2n+1 ) + ( I -^aAJM U^+T) + fl"Ua: 5 )(l— g***) + - 
1 f X } X 3 ( ^2n-l } 

is + 1 —a; 3 + •••+ x X^n-i ) if 1*1 < 1 

1 / 1 , 1 II 

andls 1 -a; 2 " 1 1 -a; + 1 — a: 3 + - + T -a-^i j if M > L 

25. Show that the series 

00 

2 __ Z”' 1 

n—1 ' 

is equal to (1 z) 2 when. \z\ < 1 and is equal to z~~ 1 ( 1 — z)~ 2 when 

w >i* 

26.f F(z) ss 

z . (L-z^L , (i- g )(i- g 2) g * 

(l-2)(l-2) (I - '2 2 )(1 z )(I — qz) ‘ (1 — g 3 )(l— z)(l— gz)(l— g 2 z) 1 
where |z| < 1 and |g , | < 1. Show that 
F(z)-F(qz) = 

g / 1 ■ U-g)* , (l — q)(l — q 2 )z 2 . 1 


| LI ZJLH ■ (I-g)(l-g 2 )z a , 1 

1-zll-gz (1 — qz)(l— q 2 z)^ (l-qz)(l-q 2 z)(l-c^z) ~"1 

= z(l-z)- 2 , 

F(z) = z(l— z)- 2 + gz(l— gz)- 2 + ... 


2 n 

l—g" z ’ 

n= 1 

27. Differentiate the result of Example 26 with respect to z and put 
— q, to obtain 

V [ 1 i 1 i i i_ \ _ V "V 
•Z (l-g B ) 2 ll— 2^ I-3 2T "‘ T l-g’*/ Z, I-g»' 


f Examples 26, 27 are taken from a paper by W. N. Bailey, Journal London 
Math.Soc.il (1936), 157. 
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1 . The definition of a real number, given in § 2, is abstruse 
and far removed from 'common sense’. Some such definition 
is a necessity and not a matter of choice, it is 'common 
sense’ to suppose that some 'number’ corresponds to each 
'length’ of line in a geometrical figure. In each of the two 
great constructive periods of mathematics this 'common-sense’ 
view has been found unsatisfactory. 

In the ancient period the Greeks found that 

(а) their theory of numbers dealt only with integers and the 
ratio of integers; 

(б) their geometry introduced lengths that could not be 
represented by such numbers, e.g. the diagonal of a unit square. 

Their solution was to accept (a), to build up a geometrical 
theory of incommensurables, and to make all geometrical pro- 
positions independent of any results discovered by means of 
(a). For example, it is almost certain that Pythagoras’ theorem 
was discovered by some variant of the argument 



The proof usually given in Book I of Euclid (even in modern 
geometries!) is one that deliberately avoids arithmetical 
arguments. 

In the modem period analysis reached the stage of very 
careful discussion of continuity, convergence, and so on, without 
any close examination of what it meant by an irrational 
number. Cauchy (p. 4 of Cours d' Analyse, 1821) merely says: 
'an irrational number is the limit of diverse fractions which 
furnish more and more approximate values of it’, and it is 
much later in the book that he builds up his technique of £ 
and N, now so familiar in the definition of what a limit is. 
That is, Cauchy takes the 'common-sense’ view of what an 
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irrational is and then builds up his theory of limits (in the strict 
mathematical sense) for both rational and irrational numbers 
Later on, when people were familiar with the idea of limit in 
the strict mathematical sense, it was inevitable that some one 
should ask, ‘what does limit mean on page 4 of Cauchy’s Cours 
d’ AnalyseV Whatever answer is given, the result is unsatis- 
factory: either ‘limit’ is used before it is defined, or the word 
‘limit’ is used in two different ways, i.e. in the first instance 
it expresses a vague notion and not a definite one. 

All attempts to build up a theory of limits, which shah be 
applicable both to rational and to irrational numbers, are bound 
to fail unless they are prefaced by an exact arithmetical defini- 
tion of rational and irrational number. 

Further, some of the work of 1 800-60 showed that geometrical 
intuitions, though frequently useful and reliable as guides to 
analytical results, were not invariably so. Analysis sometimes 
deals with functions y, of a variable x, that cannot be repre- 
sented graphically. Thus, cf. Goursat, Cours d’ Analyse, i. 75, 

OO 

y = 2 b n cos(a n rrx), 

n — 0 

where b < 1 and a is an odd integer, has the properties 

(i) it is a continuous function of x, 

(ii) it has a differential coefficient if ab < 1, but not if 
ab > l + §7 r. 

If ab > 1 + 1 77, then any notion of a graph or geometrical picture 
of the function is bound to be false: we cannot think of a graph 
that nowhere has a tangent. 

The net result of the logical difficulties into which the older 
point of view had led is that modern analysis aims at being 
purely arithmetical: even when it deals with geometrical facts 
it deals with them in an arithmetical fashion. 

Note. There is one important note to be made in this 
connexion. The arithmetical argument is often doing nothing 
more than state, in the requisite forms, facts which are indicated 
by geometry. It is frequently useful to draw a figure and see 
what geometrical intuitions are being arithmetized. 
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2. Real numbers 

We shall assume the notions of 

unity, aggregate or set, order , correspondence. 

We shall assume that the theory of positive and negative 
integers and fractions has been developed and that rules for 
their comparison (>,=,<), their addition, subtraction, multi- 
plication, and division have been given. f These are the rational 
numbers, or, to distinguish them from what we shall later call 
rational real numbers, the elementary rational numbers (e.k.) 

Anent these, we notice three results that will be particularly 
useful. 

(i) Any set of e.k. that contains 1 and is such that it must 
contain k+l if it contains k contains the unending sequence 
1 , 2, 3 ,... . This is called the Principle of Mathematical Induction. 

(ii) If a, b are two positive e.k. and a < b, then we can find 
positive integers n such that na > b. This is sometimes called 
Archimedes' Axiom from the fact that Archimedes set it out in 
a form concerning lengths of lines. 

(iii) If a is an e.k., then there is no least e.k. which exceeds a. 

Proof. If b is any e.k. greater than a, then so is J(a+6): it is 
less than b, and so b cannot be the least e.k. which exceeds a. 

Dedekind cuts or sections 

Definition. Two sets L, R of elementary rational numbers are 
said to for7n a cut when 

{a) there is at least one e.k. in each set, 

(b) each and every e.k. belongs either to L or to R, but not to both, 

(c) each and every member of L < each and every member of R. 

A real number is a cut of the elementary rational numbers. 

The notation ( L,R ) will be used to denote a cut; alterna- 
tively, in discussing particular cuts, a single letter or symbol, 
such as a, V2 will be used. 

t Cf. Hobson, Functions of a Real Variable, vol. i (1921), pp. 1-18. Any one 
who is really interested in the logical foundations of analysis will find this 
well worth reading. 
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Lemma. (L, R) is a cut and a is an e.r. of R: then any e.r. 
h that exceeds a is also in R. 

Proof . If h is in L, then (c) of the definition is not satisfied. 

Geometrical picture 

If we think of the e.r. plotted along a line, a cut will be 
given if we take a point P on that line, put all e.r. to the left 

L R 

p 

in L, all to the right in P, and, in case P itself corresponds to an 
e.r., then that e.r. may be put either in L or in R, but not in 
both. The rough geometrical picture will help to keep clear the 
implications of the arithmetical arguments which come later. 

Classification of real numbers 

There are two simple types of cut which are, quite naturally, 
called rational real numbers. 

(i) When L contains all e.r. < a given e.r. a, 

and R contains all e.r. > a, 

then the cut (P, R) is denoted by a and is called a rational real 
number. Occasionally, to avoid confusion, w r e shall use a ' for 
the rational real number, a for the e.r. 

(ii) When L contains all e.r. < a given e.r. a , 

and R contains all e.r. > a, 

then the cut ( L , R) is denoted by a and is called a rational real 
number. 

We shall refer to either of these cuts as the rational real 
number 'corresponding to the e.r. a 9 or 'derived from the 
e.r. a\ 

Note. We ought strictly, at this point, to use different 
symbols to denote the cuts of (i) and (ii): we shall see later that, 
with our definition of 'equals’, the two real numbers or cuts 
(i) and (ii) are 'equal 5 when they are derived from one and the 
same e.r. a. 

The chief characteristic to be noticed about (i) and (ii) before 
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we proceed is that in them either L has a greatest member or 
R has a least. 

We now ask 'Can we have cuts either 

(iii) such that L has a greatest and R a least member, or 

(iv) such that L has no greatest and R no least member? 5 

We see at once that the type (iii) is not possible. If possible, 
let cc be the greatest L and jS the least R\ then |(a+/J) lies 
between the two: being an e.k., it belongs either to L or to R 
if (L, R) is a cut. It follows that either j8 is not the least R or a 
is not the greatest L. 

On the other hand, w r e have only to consider the cut that is 
indicated as the obvious way of defining V2 to see that type (iv) 
is possible. Define two sets L, R of e.k. in the following way: 

every negative e.k. and 

every positive e.k. whose square < 2 belongs to L, 

every positive e.k. whose square > 2 belongs to R. 

We want to show that (L, R) is a cut. To do this we have to 
show that the conditions (a), (6), (c) are satisfied. Now it is 
clear at once from (A) that (a) there is at least one e.k. in each 

of L and R and that (c) each and every member of L < each 

and every member of R. Further, provided that there is no 
e.k. whose square is actually equal to 2, each and every e.k. 
belongs either to L or to R, but not to both. 

Hence all we need do to show that L, R give a cut is to show 
that there is no elementary rational number whose square 
is 2. This was shown by the Greeks at the time when they 
encountered the logical difficulty referred to in § 1. Many 
proofs are known both of this and of such theorems as 'There 
is no rational number whose square is mjn (where this fraction 
is expressed in its lowest terms) unless m and n are the squares 
of integers 5 . There is some interest, however, in recalling the 
traditional Greek proof. In geometrical guise (i.e. it used 
lengths of lines) it ran on the following lines: If x:y is a ratio 
in its lowest terms, then its square cannot be 2. 

For if x 2 — 2 y 2 , then x 2 is even and, since the square of every 
odd number is odd, x is even. But now two things follow: 
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(i) since x, y have no common factor, y is odd; 

(ii) since x is even, x 2 contains 4 as a factor; so y 2 is even, and 
y is also even because the square of every odd number is odd. 

Hence y is both even and odd, which is absurd. 

We now show that the cut given by (A) is one in which L 
has no least, j R no greatest member. Let x be any e.r. in L and 
let x 2 = 2—k, where h > 0. If € is a positive e.r. such that 

€ < Xj € < k/3X } 

then (x+e) 2 = 2 -]c+2x e +e* 

= 2 — h-\-e{2x-\-€) 

< 2—Jc + — Bx, 

and so x-{-€ also belongs to L. Hence x cannot be the greatest 
member of L. 

Hence L has no greatest, and similarly R has no least, 
member. 

Irrational numbers. We have just established two facts: 

(i) there is no cut ( L , R) having a greatest member in L and 
a least member in R ; 

(ii) it is possible to have a cut ( L , R) in which L has no 
greatest and R no least member. 

Definition. A cut ( L , R) in which L has no greatest and R no 
least member is called an irrational real number. 

3. The comparison of real numbers 

Suppose two numbers a , b are given by cuts, say (L 1} R x ), 
(L 2 , R 2 ). We use ‘number’ to denote ‘real number’ unless e.r. 
is expressly mentioned in the context. 

For convenience, we shall use l ± to denote any particular 
e.r. that belongs to L v and so on. Sometimes we use the 
phrase ‘an l of a’ instead of l v 
The symbols > ? =, < between real numbers. 

Either (i) all r’s of a > all Vs of b , 
or (ii) some r of a < some l of b; wdien we say a < b. 
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When (i) holds, then 

either (i a) some l of a > some r of 6 ; when we say a > b, 
or (i&) all V s of a < all r’s of 6; when we say a — b. 

In (ib) it may happen that a and b are rational and that the 
greatest l of a = the least r of b, i.e. the cuts are the same save 
that in one the e.k. corresponding to the real number goes into 
L and in the other it goes into R. 

Note. Draw a figure to see how obvious the above pro- 
cedure is. 

Positive and negative real numbers 

Positive numbers are those that are greater than zero, 
negative numbers are those that are less than zero, zero (as a 
real number) being defined as the cut that has positive e.k. 
in its R class and negative e.k. in its L class. (Positive e.k. 
refers to what is meant by positive in the domain of the 
elementary rational numbers.) 

Exercise. If x is a positive real number , then some Vs of x are 
positive e.k. 

Definition. If x denotes the cut ( L , R), then ~~x is denoted 
symbolically by ( — R, — L); if the e.k. c is an r of x, ■— c is an l 
of —x, and if the e.k. c is an l of x , — c is an r of —x. 

There is one concluding result that will exercise the reader 
in thinking about these definitions; it will be used in Theorem II. 
It is 

"If a, b are e.k. and a > 6, and if a' , b' are the rational real 
numbers derived from them , then , in the sense in which > is 
defined for real numbers, a' > 6V 

4. Operations with real numbers 

Theorem I. Given an arbitrary e.k. € > 0, we can find, for any 
given cut ( L , R), an l and an r such that r—l < e. 

If the cut (L, R) is a rational real number, the theorem is 
all but obvious. Por then either L has a greatest member, say 
l v and l x +%e is necessarily an R, or R has a least, say r v and 
r x — 2 € is an L. 
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If the cut (L, E) is an irrational real number, let l L be any 
l and r L any r: let r x — * 1 ± — a. Either a < fe and l- v r 1 are 
numbers which satisfy l 1 —r 1 < e or, by Archimedes 5 axiom, 
we can find an integer n such that \zn > a. In the latter case, 
consider the n+l e.b. 

•••> li+^ne. 

The last exceeds r L and so is in E; the first is in L; each must 
be either in L or in E , since each is an e.b. Hence one of the 
sequence is the last to be in L and the next is the first to be 
in E: their difference is i-e and w r e have found an l and an r 
such that r—l < e. 

Note. The theorem is 'obvious 5 from the geometrical picture 
of §2. 

The sum of real numbers 

Let x , y denote the real numbers or cuts (L 2 ,E 2 ). 

Divide the e.b. into two sets A, p in this way: an e.b. c belongs 
to A if w T e can find an l ± and an l 2 such that 

^1+^2 ^ c \ 

otherwise c belongs to p. 

Then, examining the conditions for a cut, we see that ( b ) 
each e.b. is either a A or a p number, and (c) each and every 
member of A < each and every member of p. 

The one thing needed to prove that (A, p) is a cut is to show 
that there is at least one e.b. belonging to A and at least one 
to p. To show this, take 

Jc 1 other than the greatest member of L x 

(if there is such a greatest), 
k 2 other than the greatest member of L 2 

(if there is such a greatest). 

Then, if c = k 1 -\-k 2 , we can find an and an l 2 such that 
l x +l 2 > c: hence this c belongs to A. 

Moreover, any c of the form r x +r 2 belongs to p. 

Hence (A ,p) is a cut; it is called the sum of x and y and is 
written x-\-y. 

An alternative method of defining x+y is given in Whittaker 



184 


APPENDIX 


and Watson’s Modern Analysis (pp. 5, 6): it is more intuitive, 
but leads to minor difficulties of detail. 

A COROLLARY TO THE DEFINITION OF SUM. If y is posi- 
tive, then A (above) contains e.r. that exceed some of the e.r. 

of % v 

0 y x x+y 

This result, needed for future reference, is geometrically 
obvious. The arithmetic proof is as follows: 

Since y > 0, L 2 contains some positive e.r. If l 2 is one such, 
then, by Theorem I, we can find an l x and an r x such that 

r l < ^1 + ^ 2 * 

Moreover, l x +l 2 is a member of A. 

The difference of real numbers. The number x—y is 
defined to be £+(— y). 

The product of real numbers 

In the first place, suppose x and y to be positive real numbers. 
We then proceed much as we did in defining a sum; put the 
e.r. c in L if we can find a positive l x and a positive U such that 
> c; otherwise put c in R. Then ( L , R) may be proved to 
be a cut, called the product of x and y , and written xy. 

If x or y (or both) is negative, then w r e frame the definition 
so that the familiar ‘rule of signs 5 for elementary rational 
numbers will still hold for real numbers; e.g. if x is negative 
and y is positive, then xy is defined as — (— x)y. 

The reciprocal of a number. If x denotes the positive 
number (L,R), then its reciprocal , Ifx, is the number (L x ,Rf), 
where R x consists of the reciprocals of all positive Vs of x and L x 
of all e.r. that are not reciprocals of positive Vs of x. 

If x denotes a negative number, then Ijx is defined to be 
-(!/-*). 

Further operations. Division by x is multiplication by 
(1/x). The reader can, if he so wishes, fill in the details of defin- 
ing x n (n an integer), Vx, etc. The details present no difficulty, 
though some care will be necessary. 
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5. The manipulation of real numbers 

To make a complete preparation for manipulating real 
numbers with the same confidence as we did before the abstract 
definition by means of cuts was known to us, w r e ought at this 
stage to set up a lengthy formal scheme. For example, the 
proposition \a < a when a > 0, though easily proved, is not so 
obvious that it can be dismissed as silly when we are discuss- 
ing real numbers. Again, the theorems in proportion must be 
proved for real numbers, e.g. if a/b = cjd then ad = be. 

The definitions of real numbers, their sums, products, etc., 
are, in fact, such that the ordinary arithmetical manipulations 
hold for them as for the elementary rationals. If we begin to 
prove this for particular steps, it soon becomes obvious that 
such is the case generally, and we shall not attempt to prove up 
to the hilt for real numbers any property that is reasonably 
obvious from our experience in dealing w r ith numbers as we 
understood them before we considered cuts. 

6. Upper and lower bounds 

We shall use the notation introduced in Chapter II. 

Theorem II. If (L, B) is a cut denoted by G , then-f 
e > 0; 3 an r of G . r f < G+e; 
also , 3 an l of G . V > G — e. 

By the corollary to the definition of a sum, 

3 an l of (?+€ > some r of G. (1) 

But G+<= > each and every V derived from an e.r. that is an 
l of the cut <■?-)-€. 

[Note. We cannot say G+e ^ l, because G+e is a real 
number, while l is an e.r., and we have set up no machinery 
for comparing a cut of the e.r. with one single e.r.] 

Hence 

Cr+e ^ the particular V derived from the l 

that has been found in (1) 

> the r' derived from the r found in (1). 

f r' is the rational real ‘derived from r\ 
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This proves the first part of the theorem ; the second part may 
be proved in similar fashion. 

First fundamental assumption of Chapter III 

In the work on convergence that preceded the present dis- 
cussion of real numbers we built up our theory on the following 
assumption: 

If (aj is a sequence of numbers and there is one number 
A ^ every cc n , then there is a least number, U, that is greater 
than or equal to every ot n . 

We are now in a position to prove that this assumption is a 
consequence of our definition of real number. 

Theorem III. Let {a} denote an arbitrary set of real numbers. 
Let there be a number A 0 ^ each and every member of {a}. Let 
{A} denote the set of all numbers that are greater than or equal to 
each and every member of {a}. Then {A} possesses a least element 
U, which is called the upper bound of {a}. 

Every rational real number is or is not an A. Define two sets 
L } R of e.r. thus: — the e.r. c belongs to L if the rational real 
number derived from it is not an A, and otherwise it belongs 
to R. 

Then there are e.r.’s that belong to L and, since A 0 > each 
and every a, there are e.r.’s that belong to R. Also, every e.r. 
goes either into L or into R , and each and every l < each and 
every r, so that ( L } R) is a cut. Denote this cut by U . By 
Theorem II, 

€ > 0; 3 r of U such that C7+e > r\ 
where r' is the rational real derived from r. Hence 


U+e > e&ch and every a. (i) 

This is true for every positive e, and therefore 

U > each and every a . (ii) 


N.B. The. argument used to derive (ii) from (i) is of frequent occur- 
rence in analysis. 

If the argument is not at once clear, consider the following. If (ii) 
does not hold, then there must be at least one a, say a l9 that exceeds U . 
In that case Z7+i(«i~ U) < U'+(o 1 - U) = a v 


i.e. when e = l{a x —U), f7-f € < a certain a, and (i) is denied. 
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It follows, then, that D belongs to {A}. 

Moreover, if U' < U, 3 an r of U' < an l of U, and so U' < 
some a (by the way in which L was formed). Hence V is in 
{A} and any number less than U is not. 

7. Greatest and least limits 

We recall, from Chapter XI, § 2, the formal definition of an 
Interval 5 . 

Let {a} denote any set of numbers. If x is such that in each 
and every open interval 8 X containing x there is at least one a 
other than x itself, then x is called a limit point of {a}. The 
number x itself may or may not belong to {a } — see examples 
below. 

If a; is a limit point of {a}, then each open interval 8 X con- 
taining x contains an infinity of a. For, if a given 8 X contained 
only a finite number of a, then there would be a greatest a 
that was less than x and a least a that was greater than x ; 
there would be no a other than, possibly, x itself between them. 
That is, there would be an interval about x with no a, save 
possibly x, in it. This is contrary to the supposition that x is 
a limit point of {a}. 

Examples. If {a} consists of all y such that 0 < y < 1, 
then every x such that 0 ^ x ^ 1 is a limit point of {a}. 

If {a} consists of the sequence 

112 13 14 

x 3 2 > 4 > 

then 0 and 1 are the only limit points. 

We now consider the greatest limit of a sequence (x n ). 

In the first place we suppose that ( x n ) is a bounded sequence ; 
i.e. 3 K . \x n \ < K for all n. 

Divide the e.r. into L , B thus: the e.r. c goes in B if only a 
finite number (or none) of the x n are greater than or equal to c', 
the rational real derived from c; otherwise c goes in L. Then, 
as is readily verified, (L, B) is a cut. Denote it by G. We shall 
show that G is a limit point of (x n ). By Theorem II, 

€ > 0; 3 Z , r . G — c < V, G- f-e > r'. 
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But, by definition, 

V < x n for an infinity of values of n, 

r' > x n for all save, possibly, a finite number of values of n. 
Hence 

G—e < x n < G+e for an infinity of values of n, 

so that, since e was any positive number whatsoever, G is a 
limit point of the sequence. 

Moreover, no limit point of (x n ) can exceed G . For, if p = Cr+a, 
where a > 0, then 3 an r of G such that r' < Hence, 

there is at most a finite number of values of n for which 
x n > G-\-\ql = p—\oc. Hence p is not a limit point. 

G is called the greatest limit and is denoted by limx^. 

In the course of the preceding work we have proved the 
following fact. When G' > £?, there is at most a finite number 
of the x n that exceed G'. Thus, if G = lim x n , then 
G' > G; 3 N . x n < G' when n > N. 

This is a most useful property and enters into most applications 
of the notation lim x^. 

The statements lim x n = +oo, Km^ = —oo. Suppose now 
that the sequence (x n ) is not bounded. If, however large w r e 
take the e.r. c 3 x n ^ c' for an infinity of values of n, then 
we write Iim£ n = +oo. If, however large and negative we 
take c, only a finite number of x n ^ c' (and there is an infinity 
of x n altogether), we write lim x n = — oo. 

Examples. 

1,1,24,3,1,...; lima; n = -fco. 

— 1, — 2, —3,...; lim# n = —go. 

The least limit 

The least limit, written lima^, is similarly defined.f iSTo limit 
point can be less than it. Also, if lim x n = L, then 

L' < L; 3 N . x n > L' when n ^ N. 

f An alternative definition is effected by ‘reflection in the origin’ thus: 
\imx n ~ — lim(-~ ar n ). A diagram of points x n and — x n will show the reason 
for this definition. 
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The statement lima;^ — x. As in Chapter II, we say that 
limx n = x if 

c > 0; 3 N . \x—x n \ < e when n ^ N. (1) 

It follows, almost directly from the definitions, that lima;^ 
and lim:r n are then both equal to x. For, if (1) is satisfied, and 
X is other than x, then only a finite number of the x n can lie 
in a closed interval that contains X but excludes x ; hence X 
cannot be a limit point of the x R . 

8. The second fundamental assumption 

At the conclusion of § 7 we stated formally the condition that 
a sequence (x n ) of real numbers should have x as its limit. We 
now show that 

Any irrational real number may be expressed as the limit of a 
sequence of rational real numbers. 

By Theorem II, if G denotes a given real number, then 
e > 0; 3 a rational real / . r' < (7+e. 

If G is irrational, then this r' cannot be G and w r e have r' > G. 
First take € = 1 ; then there is an r' that satisfies 

G<r' <G+ 1. 

Let r'—G = rj, and let be any number that is less than both 
7] and h 

There is then a rational real r[ that satisfies G < r[ < G+e v 
Also r[ < G+7] = r\ Let r[—G = tj v and let e 2 be any 
number that is less than both 7] x and 

There is then a rational real r 2 that satisfies 

Q < r 2 <C G- f-^2* 

Also K < G+yji = r[. 

Proceeding in this way, we determine a sequence of rational 
real numbers r[, r 2 ,... i r , n ,... i such that 

(i) r n+i <r’ w (ii) r' n > G, (iii) r' n -G < 2~ n . 

That is to say, we have determined a monotonic decreasing 
sequence of rational real numbers whose limit is G. 
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By using the V of Theorem II instead of the r r we may 
express G as the limit of a monotonic increasing sequence of 
rational real numbers. 

Thus the assumption of Chapter III, § 3, is proved to be a 
consequence of the definition of real number. 



INDEX 


Numbers refer to pages. Attention is called to the entries under * Defini- 
tions' and ‘Tests'. 


Abel’s lemma 62. 
tests 64, 91. 
continuity theorem 79. 

Absolute convergence 39, 147. 

Addition of series 39. 

Alternating series 47. 

Argument 109. 

Assumptions 16, 20. 
proofs 186, 189. 

Bailey, W. 1ST. 175. 

Binomial theorem 95, 99-102. 

Bounded series 63. 

Bounds 16, 17, 186. 

Brackets 68. 

Cauchy’s test 44. 

Cesaro’s ( C , 1) sum 155, 168. 

Circle of convergence 116. 

Comparison test 27. 

Condensation test 45. 

Continuity 79, 86. 

Convergence principle 55, 59, 89. 

Copson, E. T. 109. 

Cut or section 178. 

d’Alembert’s test 30. 

Dedekind cut 178. 

Definitions : 

alternating series 47. 
argument 109. 

Cesaro’s ( C , 1) sum 155. 
circle of convergence 116. 
continuity 86. 
convergent sequence 8, 10. 

series 4, 22. 
cut or section 178. 

Dedekind cut 178. 
divergent sequence 12. 
series 22. 

Fourier coefficients 160. 

series 160. 
f(x+Q),f(x-0) 161. 
greatest limit 188. 
irrational real number 181. 
least limit 188. 
limit of a function 78, 79. 

of a sequence 10. 
lower bound 17. 
modulus 8, 109. 
mono tonic sequence 18. 
periodic function 159. 
radius of convergence 111. 
rational real number 179. 


real number 178. 
rearrangement of series 70. 
sequence 3. 
special symbols 9. 
sum of a series 4, 22, 155. 
ultimately positive 39. 
uniform convergence 83. 
upper bound 16, 186. 

Differentiation of series 87, 113. 

Dirichlet’s tests 63, 90. 

Double series 138. 

Equating coefficients 115. 

Euler’s constant 122. 

Exponential function 96-9, 104-6 
135-7. 

Fourier coefficients 160. 
series 160. 

Gauss’s test 124. 

Geometric series 22. 

Inequalities 104. 

Integral test 120. 

Integration of series 84, 93 (ll), 113 
114. 

Irrational numbers 19, 97, 181. 

Limit 8, 10, 78, 79, 106, 127. 
double 138. 
greatest, least 188. 
theorems 36, 153. 

Logarithms 46, 98, 105, 146, 147. 
expansion of 102. 

Lower bound 17. 

M - test 90. 

Modulus 8, 11, 85, 109.' 

Monotonic sequence 18. 

Multiplication of series 75, 80. 

Non-convergent sequences 12. 

series 22. 155. 

Order notation 125. 

Order of terms 70. 

Periodic function 159. 

Power series 49, 110-17. 

Pringsheim’s theorem 43, 173 (9). 

Products, infinite 146-52. 



INDEX 




Eaabe’s test 30. 

Radius of convergence 111. 

Ratio tests 30-4, 124. 

Real number 178. 

Rearrangement of series 70-5. 

Sequence : 
definition 3. 
convergent 8, 10. 
divergent 8. 
mono tonic 18. 
non -convergent 12. 
uniformly convergent 83, 89. 
Series : 

addition of 39. 
alternating 47. 
bounded 63. 

Cesaro’s (C, 1) sum 155, 168. 
complex 109, 131. 
convergent 22. 
cosine 165. 

differentiation of 87, 113. 
double 138. 

Fourier 1 60. 

integration of 84, 93 (11), 113, 114. 
multiplication of 75, 80. 
non-convergent 22, 155. 

25 . 

positive terms 23. 
power series 49,110-17. 
rearrangement of 70-5. 
sine 165. 

trigonometric 65, 159, 173. 
uniformly convergent 82, 83, 89. 


Tannery’s theorem 133, 135. 
Technique, detail of 36. 

Tests for convergence: 

Abel’s 64; generalized 67. 
absolute convergence 60. 

Cauchy’s 44. 
comparison 27. 
condensation 45. 
d’Alembert’s 30. 

Dirichlet’s 63 ; generalized 67. 
Gauss’s 124. 
integral 120. 

Raabe’s 30. 

ratio (Rummer’s) 31. 

Tests for products 146-50. 

Tests for uniform convergence : 
Abel’s 9 1 ; generalized 92. 
Dirichlet’s 90 ; generalized 92. 

M or Weierstrass’s 90. 
Trigonometric series 65, 159, 173. 

Ultimately positive 39. 

Uniform convergence: 
of products 148. 
of sequences 83, 89. 
of series 82, 83, 89. 

Upper bound 16, 186. 

Vandermonde’s theorem 94. 

Weierstrass's M test 90. 

Whittaker, E. T. and Watson, G. N. 
183, 184. 

Zygmund, A. 160. 



